-- Logs begin at Sat 2022-09-17 20:01:17 UTC, end at Sat 2022-09-17 21:07:41 UTC. -- Sep 17 20:36:43.915316 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 17 20:36:43.924495 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 17 20:36:43 2022] *** Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: nodename: dv-osbrick-master-4-ceph Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: machine: x86_64 Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: clock source: unix Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: pcre jit disabled Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: detected number of CPU cores: 4 Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: current working directory: / Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: detected binary path: /usr/bin/uwsgi-core Sep 17 20:36:43.926619 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: your processes number limit is 47680 Sep 17 20:36:43.932128 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: your memory page size is 4096 bytes Sep 17 20:36:43.932128 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: detected max file descriptor number: 2048 Sep 17 20:36:43.932128 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: lock engine: pthread robust mutexes Sep 17 20:36:43.932128 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: thunder lock: enabled Sep 17 20:36:43.932128 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 17 20:36:43.932128 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 17 20:36:43.983371 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: Python main interpreter initialized at 0x55c58e1909c0 Sep 17 20:36:43.983371 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: python threads support enabled Sep 17 20:36:43.983371 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: your server socket listen backlog is limited to 100 connections Sep 17 20:36:43.983371 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: your mercy for graceful operations on workers is 90 seconds Sep 17 20:36:43.983748 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: mapped 403077 bytes (393 KB) for 2 cores Sep 17 20:36:43.983823 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: *** Operational MODE: preforking *** Sep 17 20:36:43.984061 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: *** uWSGI is running in multiple interpreter mode *** Sep 17 20:36:43.984061 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: spawned uWSGI master process (pid: 100101) Sep 17 20:36:43.984281 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 17 20:36:43.985099 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: spawned uWSGI worker 1 (pid: 100114, cores: 1) Sep 17 20:36:43.985230 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: spawned uWSGI worker 2 (pid: 100115, cores: 1) Sep 17 20:36:43.988282 dv-osbrick-master-4-ceph devstack@keystone.service[100101]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 17 20:36:48.681255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:36:48.681255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: from cryptography.utils import int_from_bytes Sep 17 20:36:48.682305 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:36:48.682305 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: from cryptography.utils import int_from_bytes Sep 17 20:36:48.682754 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:36:48.682754 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: from cryptography.utils import int_from_bytes Sep 17 20:36:48.682888 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:36:48.682888 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: from cryptography.utils import int_from_bytes Sep 17 20:36:48.733647 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 20:36:48.733840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 20:36:48.734028 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] command line args: [] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 20:36:48.734128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 20:36:48.734245 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 20:36:48.734334 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 20:36:48.734444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] command line args: [] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 20:36:48.734526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ================================================================================ {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 20:36:48.734713 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] admin_token = **** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.734792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 20:36:48.734874 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ================================================================================ {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 20:36:48.734946 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] config_dir = [] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.735134 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] admin_token = **** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.735221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] config_source = [] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.735412 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] config_dir = [] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.735513 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] debug = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.735601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.735716 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.735975 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] config_source = [] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.735975 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] debug = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.736102 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.736167 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.736255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] insecure_debug = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.736321 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.736480 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] insecure_debug = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.736566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.736729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.736817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.736962 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] list_limit = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737048 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737152 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] log_config_append = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737291 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] list_limit = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737429 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] log_config_append = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737492 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] log_dir = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] log_file = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] log_dir = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] log_file = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.737920 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.738104 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.738192 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.738402 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.738569 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.738703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.738838 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.738838 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.739089 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.739226 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.739369 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.739369 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.739622 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.739756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.739904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.740055 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.740186 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.740319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.740447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.740581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.740709 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.740843 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.740972 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.741106 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.741352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.741501 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.741643 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] notification_format = cadf {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.741817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] notification_format = cadf {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.741950 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.742076 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.742195 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.742195 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] publish_errors = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.742195 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.742508 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.742629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.742815 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.742942 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] publish_errors = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.743063 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.743177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.743297 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.743412 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.743530 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] standard_threads = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.743673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.743810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] strict_password_check = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.743940 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.744081 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.744211 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.744338 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] use_eventlog = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.744467 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] standard_threads = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.744582 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] use_journal = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.744582 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] use_json = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.744812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] strict_password_check = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.744928 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] use_stderr = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.745042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.745155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] use_syslog = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.745286 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] use_eventlog = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.745401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] watch_log_file = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.745533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] use_journal = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.745533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] use_json = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.745756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.745872 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] use_stderr = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.745985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.746104 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] use_syslog = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.746296 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.746413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] watch_log_file = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:36:48.746527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.746640 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.746755 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.746875 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.746999 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.747114 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.747234 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.747349 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.747462 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.747581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.747733 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.747858 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.747979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.748101 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.748223 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.748343 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.748467 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.748583 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.748702 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.748824 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.748946 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.749067 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.749222 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.749346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.749462 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.749583 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.749704 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.749831 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.749947 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.750061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.750174 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.750287 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.750401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.750522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.750638 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.750751 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.750865 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.750985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.751100 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.751225 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.751341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.751454 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.751567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.751681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.751794 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.752102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.752227 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.752334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.752453 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.752569 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.752683 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.752805 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.752921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.753035 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.753149 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.753286 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.753402 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.753533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.753650 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.753763 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.753877 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.753991 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.754105 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.754233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.754356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.754482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.754603 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.754719 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.754832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.754953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.755069 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.755183 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.755302 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.755417 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.755539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.755664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.755786 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.755901 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.756014 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.756128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.756273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.756404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.756521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.756635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.756749 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.756882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.757003 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.757127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.757271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.757927 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.758064 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.758187 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.758314 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.758431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.758555 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.758671 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.758795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.758912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.759026 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.759140 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.759264 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.759381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.759502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.759502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.759502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.759831 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.759954 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760191 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760298 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760396 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760492 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760792 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760894 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.760993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.761098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.766759 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.766889 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.766967 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767039 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767108 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767178 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767262 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767407 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767633 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767785 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.767933 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768052 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768135 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768219 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768299 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768371 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768512 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768723 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.enabled = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768805 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.768962 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769039 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769110 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769209 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769285 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769534 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769735 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.enabled = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769818 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769897 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.769978 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770059 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770203 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770351 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770424 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770495 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770793 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770867 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.770938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771007 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771077 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771147 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771304 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771453 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771684 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771827 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771897 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.771967 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772115 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772188 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772258 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772328 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772398 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772468 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772550 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772700 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772772 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.772997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.773741 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.773741 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.773882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.773956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774037 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774146 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] auth.external = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774411 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] auth.mapped = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774563 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774663 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.774954 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] auth.password = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775024 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775094 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] auth.token = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775173 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] auth.external = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775332 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] auth.mapped = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] catalog.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775481 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775708 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775779 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] auth.password = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775849 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775919 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] auth.token = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.775990 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776062 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776135 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776135 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] credential.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776135 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] credential.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776315 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] catalog.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776385 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776468 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776681 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776751 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776902 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.776973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777113 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777205 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] credential.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777292 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777366 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] credential.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777508 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777580 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777650 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.777943 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778020 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778140 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778371 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778442 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] federation.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778654 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778733 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778807 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778878 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] federation.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.778948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779090 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779242 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779313 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779313 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779440 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779511 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779664 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779735 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] federation.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779838 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.779920 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.780073 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.780165 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] federation.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.780321 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.780402 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.780553 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.780634 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.780801 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.780894 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.781036 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.781116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.781317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.781400 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.781554 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.781647 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.781816 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.781903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.782048 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.782127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.782288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.782376 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.782522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.782601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.782772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.782851 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.783005 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.783093 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.783240 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.783320 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.783475 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.783554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.783720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.783800 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.783951 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.784032 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.784189 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.784269 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.784441 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.784523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.784689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.784769 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.784919 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.784997 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.785151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.785253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.785404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.785484 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.785649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.785728 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.785895 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.785976 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.786129 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.786208 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.786368 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.786447 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.786637 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.786714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.786888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.787013 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.787137 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.787220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.787368 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.787450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.787598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.787676 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.787835 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.787914 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.788085 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.788166 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.788302 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.788380 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.788543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.789148 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.789405 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.789714 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.789796 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.789959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.password = **** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.790037 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.790202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.790289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.790443 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.790522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.790688 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.790766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.790928 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.791014 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.791167 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.791252 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.791416 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.791493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.791652 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.791738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.791884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.791962 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.792115 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.password = **** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.792191 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.792353 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.792440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.792592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.792669 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.792827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.792912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.793065 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.793152 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.793326 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.793405 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.793562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.793639 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.793805 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.795459 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.795459 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.795583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.795643 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.795701 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.795776 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.795851 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.795921 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.795991 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796130 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796291 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796366 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796561 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796710 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796780 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796849 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796918 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.796987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797064 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797135 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797291 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797362 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797513 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797656 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797725 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797794 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.797864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.798013 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.798100 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.798227 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.798306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.798467 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.798544 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.798707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.798786 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.798946 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.799023 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.799193 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.799270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.799441 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.799519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.799682 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.799759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.799914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.799991 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] policy.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.800155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.800234 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.800392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.800468 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.800628 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.800704 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.800851 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] receipt.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.800956 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.801112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.801211 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.801386 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.801464 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.801644 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.801723 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.801884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.801961 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.802128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.802204 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] policy.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.802356 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.802441 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] resource.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.802601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.802678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.802836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.802914 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] resource.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.803071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] receipt.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.803150 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.803306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.803384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.803552 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.803629 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.803788 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] revoke.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.803866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.804018 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.804094 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.804303 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.804936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.805274 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] role.cache_time = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.805525 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] role.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.805632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] resource.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.805780 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] role.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.805887 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.806020 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] role.list_limit = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.806139 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] resource.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.806274 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.806380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.806526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.806633 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.806778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.806910 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.807385 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] revoke.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.807491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.807589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.807686 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.807791 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.807890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.807986 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] role.cache_time = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.808081 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.808177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] role.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.808309 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.808423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] role.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.808522 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.808619 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] role.list_limit = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.808716 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.808812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.808907 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.809013 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.809112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.809242 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.809345 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.809442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.809595 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.809723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.809847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.809951 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.810097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.810203 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.810346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.810460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.810571 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.810669 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.810817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.810922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.811066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.811180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.811314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.811419 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.811563 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.811668 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.811805 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.811974 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.812080 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.812705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.812807 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.812904 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.813018 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.813117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.813243 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.813343 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.813449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.813564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.813664 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.813773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.813835 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814148 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814209 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814209 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] token.cache_time = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814323 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814381 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] token.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814670 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814833 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.814902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] token.provider = fernet {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.815322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.815408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.815471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.815529 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.815597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.815673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.815823 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.815902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.816062 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.816141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.816300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.816381 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.816533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] token.cache_time = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.816611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] trust.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.816769 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] token.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.816848 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.817009 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.817095 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.817271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.817351 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] token.provider = fernet {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.817510 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.817587 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.817770 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.817850 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.818017 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.818104 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.818253 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.818331 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.818499 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.818577 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.818743 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.818822 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.connection = **** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.818993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] trust.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.819071 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.819232 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.819318 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.819469 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.819547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.819703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.819780 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.819993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.820087 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.820310 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.820642 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.820750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.820886 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.820963 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.821136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.821296 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.821454 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.821531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.821635 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.821759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.connection = **** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.821882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.822105 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.822195 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.822351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.822430 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.822593 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.822670 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.822823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.822910 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.823065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.823144 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.823301 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.823380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.823474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 20:36:48.823565 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.823765 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.824013 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.824251 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.824495 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.824734 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.824986 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.825255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.825505 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.825739 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.825980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.826252 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:36:48.826426 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 20:36:48.853423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.853652 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.853879 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.860751 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.860987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.861239 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.862643 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.871137 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.902899 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.903133 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.904110 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.904344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.965751 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:48.969272 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.015410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.015642 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.017125 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.017391 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.093062 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.093319 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.093547 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.093633 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.093770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.093855 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.093990 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.094083 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.094208 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.094290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.094424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.094643 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.118530 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.118767 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.118994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.119151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.119238 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.119390 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.119472 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.119615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.119696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.119827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.119907 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.120062 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.120257 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.120468 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.131054 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.131341 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.152148 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.152414 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.152614 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.152757 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.152840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.152994 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.153116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.153250 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.153333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.153462 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.153556 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.153685 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.153900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.154114 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 20:36:49.170243 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.170450 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 20:36:49.170792 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.170993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 20:36:49.171078 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.171213 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 20:36:49.171294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.171519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.171599 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.171744 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 20:36:49.171824 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.172021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.172102 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.172285 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.172548 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.172810 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.182210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.182489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.182758 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.183038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.183543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.183826 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.184100 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.184381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.190365 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.191621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.193285 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.193572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.193857 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.194143 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.194427 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.194671 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.194753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.195641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.195946 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.196043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.196220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.196300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.196499 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.196578 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.196772 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.196853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.197054 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.197352 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.197632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.197943 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.198222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.198493 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.221465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.221566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.221786 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.222239 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.223717 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.224001 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.227117 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.227419 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.229308 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.229774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.230062 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.231937 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.235854 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.236138 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.238475 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.238760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.240179 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.240481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.240775 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.241186 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.241466 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.241804 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.242163 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.242458 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.243287 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.243593 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.243875 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.244268 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.244556 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.244835 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.245126 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.245436 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.258816 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.259094 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.262528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.262813 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.263060 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.266237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.266646 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.266749 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.270907 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.274786 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.275327 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.275775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.277960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.278261 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.278545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.278941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.279238 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.279523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.280183 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.283490 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.286625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.286928 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.287214 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.287621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.287915 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.288201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.299913 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.300225 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.300484 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.300751 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.305035 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.305352 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.305631 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.305899 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.307673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.309353 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.310907 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.311186 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.312679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.313856 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.314403 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.314622 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.314706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.333974 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.333974 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.334116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334479 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.334552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.334985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.334985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.335323 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.344919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.347965 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.350879 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.350982 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.352448 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.353936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.354229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.354504 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.354588 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.357449 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.358901 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.360371 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.360663 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.360968 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.361063 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.362502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.365427 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.365719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.366014 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.366291 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.368132 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.369633 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.372507 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.372807 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.373095 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.373399 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.374375 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.374670 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.374956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.381559 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.381866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.382142 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.383375 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=100114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.383657 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.383940 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.384231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.384517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.384791 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.385067 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.385369 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.385660 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.385931 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.386218 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.386482 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.386749 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.387149 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=100114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.391033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=100115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 20:36:49.391326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.391612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.391894 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.392186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.392466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.392740 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.393010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.393323 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.393597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.393886 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.394148 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.394413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.394672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=100115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 20:36:49.420813 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c58e1909c0 pid: 100114 (default app) Sep 17 20:36:49.424266 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031133-9db9-45d8-b5e1-4fb591968d88 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:36:49.424555 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031133-9db9-45d8-b5e1-4fb591968d88 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:36:49.424829 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031133-9db9-45d8-b5e1-4fb591968d88 None None] PATH_INFO: `/v3` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:36:49.428979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Sat Sep 17 20:36:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:36:49.429801 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c58e1909c0 pid: 100115 (default app) Sep 17 20:36:57.790497 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453a33-5523-43c4-8392-0cb2c9c483b8 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:36:57.791020 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453a33-5523-43c4-8392-0cb2c9c483b8 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:36:57.791020 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453a33-5523-43c4-8392-0cb2c9c483b8 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:36:57.792456 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:36:57.800193 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060833a-423a-430b-945f-2d854310223e None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:36:57.800722 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060833a-423a-430b-945f-2d854310223e None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:36:57.800816 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060833a-423a-430b-945f-2d854310223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:36:57.893993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: INFO dbcounter [None req-d060833a-423a-430b-945f-2d854310223e None None] Registered counter for database keystone Sep 17 20:36:57.920868 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG oslo_db.sqlalchemy.engines [None req-d060833a-423a-430b-945f-2d854310223e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:36:57.927460 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writer thread running {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:36:58.141561 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG passlib.handlers.bcrypt [None req-d060833a-423a-430b-945f-2d854310223e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=100115) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 20:36:58.141945 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG passlib.handlers.bcrypt [None req-d060833a-423a-430b-945f-2d854310223e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=100115) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 20:36:58.204677 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d060833a-423a-430b-945f-2d854310223e None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:36:58.206316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d060833a-423a-430b-945f-2d854310223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:36:58.347685 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 1/3] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:36:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 17 20:36:58.887855 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453a33-5523-43c4-8392-0cb2c9c483b8 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:36:58.963989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: INFO dbcounter [None req-1c453a33-5523-43c4-8392-0cb2c9c483b8 None None] Registered counter for database keystone Sep 17 20:36:58.985806 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG oslo_db.sqlalchemy.engines [None req-1c453a33-5523-43c4-8392-0cb2c9c483b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:36:58.991974 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writer thread running {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:36:59.111418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453a33-5523-43c4-8392-0cb2c9c483b8 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:36:59.115627 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b66bd-73de-40e0-83ea-d9ae5d649530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:36:59.116238 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b66bd-73de-40e0-83ea-d9ae5d649530 admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:36:59.116519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b66bd-73de-40e0-83ea-d9ae5d649530 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:36:59.116790 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b66bd-73de-40e0-83ea-d9ae5d649530 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:36:59.125054 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b66bd-73de-40e0-83ea-d9ae5d649530 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:36:59.177204 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WARNING keystone.common.rbac_enforcer.enforcer [None req-657b66bd-73de-40e0-83ea-d9ae5d649530 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 20:36:59.177552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b66bd-73de-40e0-83ea-d9ae5d649530 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:36:59.186988 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1324 bytes} [Sat Sep 17 20:36:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 20:36:59.193237 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060833a-423a-430b-945f-2d854310223e None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:36:59.210427 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060833a-423a-430b-945f-2d854310223e None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:36:59.215572 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1e89-aed7-4950-bab5-71debece8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:36:59.216681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1e89-aed7-4950-bab5-71debece8282 admin admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:36:59.216978 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1e89-aed7-4950-bab5-71debece8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:36:59.217285 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1e89-aed7-4950-bab5-71debece8282 admin admin] PATH_INFO: `/v3/projects/a1449954a4a84885b4be97fe68c1c864` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:36:59.218727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c1e89-aed7-4950-bab5-71debece8282 admin admin] RBAC: Authorizing `identity:get_project(project_id=a1449954a4a84885b4be97fe68c1c864)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:36:59.269776 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cc2c1e89-aed7-4950-bab5-71debece8282 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 20:36:59.270124 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c1e89-aed7-4950-bab5-71debece8282 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:36:59.275308 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 2/5] 10.222.0.52 () {56 vars in 1207 bytes} [Sat Sep 17 20:36:59 2022] GET /identity/v3/projects/a1449954a4a84885b4be97fe68c1c864 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:01.683492 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a6132-305b-4a26-8b53-c7cfbea86a8e None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:01.684111 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a6132-305b-4a26-8b53-c7cfbea86a8e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:01.684111 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a6132-305b-4a26-8b53-c7cfbea86a8e None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:01.688133 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 4/6] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:01.693767 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f053c-b9b1-4c27-828d-7a00bcce1d20 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:01.694160 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f053c-b9b1-4c27-828d-7a00bcce1d20 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:01.694330 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f053c-b9b1-4c27-828d-7a00bcce1d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:01.714806 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-7e3f053c-b9b1-4c27-828d-7a00bcce1d20 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:01.716319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-7e3f053c-b9b1-4c27-828d-7a00bcce1d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:01.724125 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 3/7] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 17 20:37:02.050409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a6132-305b-4a26-8b53-c7cfbea86a8e None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:02.062963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a6132-305b-4a26-8b53-c7cfbea86a8e None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:02.067310 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7e2b2-20e1-4ec0-8881-4d3742acc83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:02.067892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e2b2-20e1-4ec0-8881-4d3742acc83f admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:02.068168 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e2b2-20e1-4ec0-8881-4d3742acc83f admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:02.068438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e2b2-20e1-4ec0-8881-4d3742acc83f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:02.076116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7e2b2-20e1-4ec0-8881-4d3742acc83f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:02.077914 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7e2b2-20e1-4ec0-8881-4d3742acc83f admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:02.086474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1324 bytes} [Sat Sep 17 20:37:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 20:37:02.092000 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f053c-b9b1-4c27-828d-7a00bcce1d20 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:02.100912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f053c-b9b1-4c27-828d-7a00bcce1d20 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:02.106082 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabaf43-5718-460e-96e9-a50de18676ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:02.106699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabaf43-5718-460e-96e9-a50de18676ad admin admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:02.106981 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabaf43-5718-460e-96e9-a50de18676ad admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:02.107253 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabaf43-5718-460e-96e9-a50de18676ad admin admin] PATH_INFO: `/v3/users/c1b97854cfd447a990a1e65cc1830977` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:02.108536 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabaf43-5718-460e-96e9-a50de18676ad admin admin] RBAC: Authorizing `identity:get_user(user_id=c1b97854cfd447a990a1e65cc1830977)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:02.110419 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabaf43-5718-460e-96e9-a50de18676ad admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:02.111928 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 4/9] 10.222.0.52 () {56 vars in 1198 bytes} [Sat Sep 17 20:37:02 2022] GET /identity/v3/users/c1b97854cfd447a990a1e65cc1830977 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:04.587653 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d96f8-f66e-450e-a597-48a359b4af9d None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:04.588207 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d96f8-f66e-450e-a597-48a359b4af9d None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:04.588207 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d96f8-f66e-450e-a597-48a359b4af9d None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:04.589537 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:04.595319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054ba8e-2a36-40c3-b5b6-daae7e5309c0 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:04.595730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054ba8e-2a36-40c3-b5b6-daae7e5309c0 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:04.595856 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054ba8e-2a36-40c3-b5b6-daae7e5309c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:04.613797 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-0054ba8e-2a36-40c3-b5b6-daae7e5309c0 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:04.614980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-0054ba8e-2a36-40c3-b5b6-daae7e5309c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:04.646373 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37366067-6ee5-42da-b587-f6e1fcd854cf None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:04.646747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37366067-6ee5-42da-b587-f6e1fcd854cf None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:04.647096 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37366067-6ee5-42da-b587-f6e1fcd854cf None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:04.648502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 7/11] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:37:04.654260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec3e4-f4b5-49a0-876d-d0cd1b222922 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:04.654542 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec3e4-f4b5-49a0-876d-d0cd1b222922 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:04.654823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec3e4-f4b5-49a0-876d-d0cd1b222922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:04.704525 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG passlib.handlers.bcrypt [None req-6c5ec3e4-f4b5-49a0-876d-d0cd1b222922 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=100114) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 20:37:04.704925 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG passlib.handlers.bcrypt [None req-6c5ec3e4-f4b5-49a0-876d-d0cd1b222922 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=100114) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 20:37:04.710890 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 5/12] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:04.755608 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-6c5ec3e4-f4b5-49a0-876d-d0cd1b222922 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:04.757226 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-6c5ec3e4-f4b5-49a0-876d-d0cd1b222922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:04.860246 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 8/13] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:05.045996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054ba8e-2a36-40c3-b5b6-daae7e5309c0 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:05.069320 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:05.200040 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ec3e4-f4b5-49a0-876d-d0cd1b222922 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:05.259513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054ba8e-2a36-40c3-b5b6-daae7e5309c0 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:05.292356 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa84273-2358-4be6-9b69-3befa68e87bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:05.292983 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa84273-2358-4be6-9b69-3befa68e87bc None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:05.293294 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa84273-2358-4be6-9b69-3befa68e87bc None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:05.293566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa84273-2358-4be6-9b69-3befa68e87bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:05.300623 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ec3e4-f4b5-49a0-876d-d0cd1b222922 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:05.302860 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:05.304450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa84273-2358-4be6-9b69-3befa68e87bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-3aa84273-2358-4be6-9b69-3befa68e87bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:05.313325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:05.314317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:05.315442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 6/14] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:05.321090 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa84273-2358-4be6-9b69-3befa68e87bc None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:05.337942 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe5917-8902-4d1c-a769-e764bb001b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:05.338800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe5917-8902-4d1c-a769-e764bb001b05 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:05.339078 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe5917-8902-4d1c-a769-e764bb001b05 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:05.339350 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe5917-8902-4d1c-a769-e764bb001b05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:05.402071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:05.406725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe5917-8902-4d1c-a769-e764bb001b05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:05.408339 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe5917-8902-4d1c-a769-e764bb001b05 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:05.419272 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa84273-2358-4be6-9b69-3befa68e87bc None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:05.453423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d822eb7-fd11-4765-80ab-d7a491940fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:05.453951 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822eb7-fd11-4765-80ab-d7a491940fb4 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:05.454226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822eb7-fd11-4765-80ab-d7a491940fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:05.454494 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822eb7-fd11-4765-80ab-d7a491940fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:05.455257 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d822eb7-fd11-4765-80ab-d7a491940fb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:05.455465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d822eb7-fd11-4765-80ab-d7a491940fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:05.456847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d822eb7-fd11-4765-80ab-d7a491940fb4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:05.468895 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 7/15] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:05.474743 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d822eb7-fd11-4765-80ab-d7a491940fb4 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:05.510262 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 9/16] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 20:37:05.515766 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe5917-8902-4d1c-a769-e764bb001b05 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:05.518518 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:05.577299 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d822eb7-fd11-4765-80ab-d7a491940fb4 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:05.612464 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915290a-ab14-4c21-9480-b0c5f438bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:05.613070 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe5917-8902-4d1c-a769-e764bb001b05 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:05.614028 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915290a-ab14-4c21-9480-b0c5f438bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:05.614028 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915290a-ab14-4c21-9480-b0c5f438bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:05.614028 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915290a-ab14-4c21-9480-b0c5f438bdb1 None admin] PATH_INFO: `/v3/users/c1b97854cfd447a990a1e65cc1830977` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:05.615036 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915290a-ab14-4c21-9480-b0c5f438bdb1 None admin] RBAC: Authorizing `identity:get_user(user_id=c1b97854cfd447a990a1e65cc1830977)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:05.616531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915290a-ab14-4c21-9480-b0c5f438bdb1 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:05.618291 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 8/17] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:05 2022] GET /identity/v3/users/c1b97854cfd447a990a1e65cc1830977 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:05.623787 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915290a-ab14-4c21-9480-b0c5f438bdb1 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:05.638560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:05.646972 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8b213-9b10-4c54-86db-6ca16f8f1a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:05.647819 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8b213-9b10-4c54-86db-6ca16f8f1a96 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:05.648108 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8b213-9b10-4c54-86db-6ca16f8f1a96 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:05.648374 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8b213-9b10-4c54-86db-6ca16f8f1a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:05.667975 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8b213-9b10-4c54-86db-6ca16f8f1a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:05.671908 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8b213-9b10-4c54-86db-6ca16f8f1a96 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-46c8b213-9b10-4c54-86db-6ca16f8f1a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:37:05.689140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:05.690044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:37:05.691125 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:37:05.691125 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:37:05.691125 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:05.691125 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 10/18] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:37:05.696531 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8b213-9b10-4c54-86db-6ca16f8f1a96 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:05.730298 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915290a-ab14-4c21-9480-b0c5f438bdb1 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:05.766881 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ceab51-e44d-49d7-82b7-716f17c5824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:05.767624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ceab51-e44d-49d7-82b7-716f17c5824c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:05.767908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ceab51-e44d-49d7-82b7-716f17c5824c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:05.768179 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ceab51-e44d-49d7-82b7-716f17c5824c None admin] PATH_INFO: `/v3/domains/default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:05.769394 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ceab51-e44d-49d7-82b7-716f17c5824c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:05.770875 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ceab51-e44d-49d7-82b7-716f17c5824c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:05.772485 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 9/19] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:05.779423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ceab51-e44d-49d7-82b7-716f17c5824c None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:05.862289 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:05.866413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:05.885389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ceab51-e44d-49d7-82b7-716f17c5824c None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:05.905023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8b213-9b10-4c54-86db-6ca16f8f1a96 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:05.919968 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7035dc6-52b9-41fa-8ef8-4d8074af2721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:05.920615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7035dc6-52b9-41fa-8ef8-4d8074af2721 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:05.920902 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7035dc6-52b9-41fa-8ef8-4d8074af2721 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:05.921192 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7035dc6-52b9-41fa-8ef8-4d8074af2721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:05.921974 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7035dc6-52b9-41fa-8ef8-4d8074af2721 None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.domain.id=default, user.id=c1b97854cfd447a990a1e65cc1830977) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:05.922283 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7035dc6-52b9-41fa-8ef8-4d8074af2721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:05.923712 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7035dc6-52b9-41fa-8ef8-4d8074af2721 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:05.930396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1322 bytes} [Sat Sep 17 20:37:05 2022] GET /identity/v3/role_assignments?user.id=c1b97854cfd447a990a1e65cc1830977&scope.domain.id=default&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:05.938966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c9565-4069-4c7e-afd2-a51861c92c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:05.939588 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c9565-4069-4c7e-afd2-a51861c92c1c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:05.939865 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c9565-4069-4c7e-afd2-a51861c92c1c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:05.940393 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c9565-4069-4c7e-afd2-a51861c92c1c None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:05.941057 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c9565-4069-4c7e-afd2-a51861c92c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:05.941393 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c9565-4069-4c7e-afd2-a51861c92c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:05.942838 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c9565-4069-4c7e-afd2-a51861c92c1c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:05.964144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 11/21] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:09.042760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12decc-1047-4d7b-b53c-4c66bb292acc None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:09.043797 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12decc-1047-4d7b-b53c-4c66bb292acc None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:09.044304 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12decc-1047-4d7b-b53c-4c66bb292acc None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:09.045865 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:09.054609 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e099a-cf68-46f7-bfcf-0f6732626832 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:09.055107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e099a-cf68-46f7-bfcf-0f6732626832 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:09.055744 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e099a-cf68-46f7-bfcf-0f6732626832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:09.081712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-a34e099a-cf68-46f7-bfcf-0f6732626832 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:09.082837 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-a34e099a-cf68-46f7-bfcf-0f6732626832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:09.111071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156a43d-76eb-4290-80fa-6b995ed4efbe None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:09.111694 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156a43d-76eb-4290-80fa-6b995ed4efbe None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:09.112185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156a43d-76eb-4290-80fa-6b995ed4efbe None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:09.113768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 12/23] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:37:09.119747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d69544-d319-4b6b-aa81-e8ebfbea24c8 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:09.120277 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d69544-d319-4b6b-aa81-e8ebfbea24c8 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:09.120762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d69544-d319-4b6b-aa81-e8ebfbea24c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:09.139053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d6d69544-d319-4b6b-aa81-e8ebfbea24c8 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:09.140607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d6d69544-d319-4b6b-aa81-e8ebfbea24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:09.192012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 12/24] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:09.261522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 13/25] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:09.493103 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ba7c3-ebb8-448a-9f6a-05547f78abbb None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:09.493647 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ba7c3-ebb8-448a-9f6a-05547f78abbb None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:09.494090 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ba7c3-ebb8-448a-9f6a-05547f78abbb None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:09.495577 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 13/26] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:09.500961 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ef45e-5971-4762-a402-6b9e430b9ce3 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:09.501282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ef45e-5971-4762-a402-6b9e430b9ce3 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:09.501564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ef45e-5971-4762-a402-6b9e430b9ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:09.526579 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-3f7ef45e-5971-4762-a402-6b9e430b9ce3 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:09.527770 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-3f7ef45e-5971-4762-a402-6b9e430b9ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:09.629864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 14/27] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:09.756256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ba7c3-ebb8-448a-9f6a-05547f78abbb None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:09.816849 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:09.886844 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ef45e-5971-4762-a402-6b9e430b9ce3 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:09.890940 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:09.901985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ba7c3-ebb8-448a-9f6a-05547f78abbb None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:09.973225 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a246ec9-ca11-44eb-8f95-7ebe6249bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:09.973866 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a246ec9-ca11-44eb-8f95-7ebe6249bf06 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:09.974142 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a246ec9-ca11-44eb-8f95-7ebe6249bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:09.974408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a246ec9-ca11-44eb-8f95-7ebe6249bf06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:09.994102 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a246ec9-ca11-44eb-8f95-7ebe6249bf06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:09.995580 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a246ec9-ca11-44eb-8f95-7ebe6249bf06 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-1a246ec9-ca11-44eb-8f95-7ebe6249bf06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:37:10.024732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:10.025707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:37:10.026487 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:37:10.026487 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:37:10.026487 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:10.032939 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 14/28] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:10.035333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19190-cfb9-46f5-85a9-0c7fbd366c77 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.036931 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19190-cfb9-46f5-85a9-0c7fbd366c77 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.037395 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19190-cfb9-46f5-85a9-0c7fbd366c77 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.038774 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 15/29] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:10.040845 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19190-cfb9-46f5-85a9-0c7fbd366c77 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:10.081567 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ef45e-5971-4762-a402-6b9e430b9ce3 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:10.120336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1ffd6-2947-49ce-bb1e-0b10363d7534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:10.121389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1ffd6-2947-49ce-bb1e-0b10363d7534 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.121804 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1ffd6-2947-49ce-bb1e-0b10363d7534 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.122224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1ffd6-2947-49ce-bb1e-0b10363d7534 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.123046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1ffd6-2947-49ce-bb1e-0b10363d7534 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:10.124570 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1ffd6-2947-49ce-bb1e-0b10363d7534 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:10.169009 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:10.173803 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19190-cfb9-46f5-85a9-0c7fbd366c77 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:10.213458 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dd6fa-451d-4efc-9839-938d231d277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:10.214083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dd6fa-451d-4efc-9839-938d231d277c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.214396 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dd6fa-451d-4efc-9839-938d231d277c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.214739 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dd6fa-451d-4efc-9839-938d231d277c None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.215409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dd6fa-451d-4efc-9839-938d231d277c None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:10.215716 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dd6fa-451d-4efc-9839-938d231d277c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:10.217154 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dd6fa-451d-4efc-9839-938d231d277c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:10.232248 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 16/30] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:10.236301 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63159-6aa2-4164-80a9-5b6b26910349 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.236301 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63159-6aa2-4164-80a9-5b6b26910349 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.236301 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63159-6aa2-4164-80a9-5b6b26910349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.253865 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-97e63159-6aa2-4164-80a9-5b6b26910349 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:10.255879 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-97e63159-6aa2-4164-80a9-5b6b26910349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:10.323516 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 17/31] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:10.324275 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e63159-6aa2-4164-80a9-5b6b26910349 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:10.363120 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 15/32] 10.222.0.52 () {60 vars in 1131 bytes} [Sat Sep 17 20:37:09 2022] POST /identity/v3/roles => generated 219 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:10.364998 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288b21d-2d68-40f9-9114-e8990ce022b0 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.365467 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288b21d-2d68-40f9-9114-e8990ce022b0 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.365723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288b21d-2d68-40f9-9114-e8990ce022b0 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.367394 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:10.368376 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288b21d-2d68-40f9-9114-e8990ce022b0 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:10.450830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:10.457083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e63159-6aa2-4164-80a9-5b6b26910349 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:10.497538 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5b5bf-7e6f-4706-82ca-b3ece28bdcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:10.498723 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b5bf-7e6f-4706-82ca-b3ece28bdcac None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.499207 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b5bf-7e6f-4706-82ca-b3ece28bdcac None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.499632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b5bf-7e6f-4706-82ca-b3ece28bdcac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.515568 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5b5bf-7e6f-4706-82ca-b3ece28bdcac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-15f5b5bf-7e6f-4706-82ca-b3ece28bdcac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:10.523689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:10.525465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:10.526440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:10.528645 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 18/34] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:10.530338 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02358d99-50d8-4e47-8d0f-597f1827fb97 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.534780 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02358d99-50d8-4e47-8d0f-597f1827fb97 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.534780 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02358d99-50d8-4e47-8d0f-597f1827fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.555480 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-02358d99-50d8-4e47-8d0f-597f1827fb97 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:10.557578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-02358d99-50d8-4e47-8d0f-597f1827fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:10.629666 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:10.640840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 19/35] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:10.643816 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02358d99-50d8-4e47-8d0f-597f1827fb97 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:10.698882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288b21d-2d68-40f9-9114-e8990ce022b0 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:10.739400 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:10.742512 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fc094-9431-4737-8b04-79354d608dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:10.743731 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc094-9431-4737-8b04-79354d608dd7 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.744201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc094-9431-4737-8b04-79354d608dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.744524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc094-9431-4737-8b04-79354d608dd7 None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.745203 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fc094-9431-4737-8b04-79354d608dd7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:10.746808 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fc094-9431-4737-8b04-79354d608dd7 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:10.765064 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02358d99-50d8-4e47-8d0f-597f1827fb97 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:10.802739 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5f911-5eb4-48a2-aad6-c568c7babcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:10.803500 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5f911-5eb4-48a2-aad6-c568c7babcaa None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.803874 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5f911-5eb4-48a2-aad6-c568c7babcaa None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.804148 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5f911-5eb4-48a2-aad6-c568c7babcaa None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.804911 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5f911-5eb4-48a2-aad6-c568c7babcaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:10.805876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5f911-5eb4-48a2-aad6-c568c7babcaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:10.807597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5f911-5eb4-48a2-aad6-c568c7babcaa None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:10.825583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 20/36] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:10.825583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f905-78a9-4fe5-9fe6-c3fb92718944 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:10.825583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f905-78a9-4fe5-9fe6-c3fb92718944 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:10.825583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f905-78a9-4fe5-9fe6-c3fb92718944 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:10.825583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 21/37] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:10.825583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63f905-78a9-4fe5-9fe6-c3fb92718944 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:10.917541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 17/38] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:37:10 2022] POST /identity/v3/projects => generated 301 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:10.917541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fc094-9431-4737-8b04-79354d608dd7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:10.943721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63f905-78a9-4fe5-9fe6-c3fb92718944 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:10.999270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd36473-ef95-44f5-84df-61eaee69aec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:10.999902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd36473-ef95-44f5-84df-61eaee69aec9 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:11.000183 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd36473-ef95-44f5-84df-61eaee69aec9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:11.000753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd36473-ef95-44f5-84df-61eaee69aec9 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:11.001503 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd36473-ef95-44f5-84df-61eaee69aec9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:11.004308 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd36473-ef95-44f5-84df-61eaee69aec9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:11.038574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fc094-9431-4737-8b04-79354d608dd7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:11.058820 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:11.077555 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c09e76-46d6-45f0-bdea-1fea255d6c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:11.078216 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c09e76-46d6-45f0-bdea-1fea255d6c18 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:11.078503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c09e76-46d6-45f0-bdea-1fea255d6c18 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:11.078785 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c09e76-46d6-45f0-bdea-1fea255d6c18 None admin] PATH_INFO: `/v3/users/c1b97854cfd447a990a1e65cc1830977` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:11.080045 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c09e76-46d6-45f0-bdea-1fea255d6c18 None admin] RBAC: Authorizing `identity:get_user(user_id=c1b97854cfd447a990a1e65cc1830977)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:11.081603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c09e76-46d6-45f0-bdea-1fea255d6c18 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:11.083749 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 18/39] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:10 2022] GET /identity/v3/users/c1b97854cfd447a990a1e65cc1830977 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:11.085007 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4fc21-3ae4-462a-936b-e0cf00eb6dd7 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:11.085324 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4fc21-3ae4-462a-936b-e0cf00eb6dd7 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:11.085604 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4fc21-3ae4-462a-936b-e0cf00eb6dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:11.092768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:11.105841 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-a1f4fc21-3ae4-462a-936b-e0cf00eb6dd7 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:11.107394 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-a1f4fc21-3ae4-462a-936b-e0cf00eb6dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:11.187565 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 19/40] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:11.188351 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4fc21-3ae4-462a-936b-e0cf00eb6dd7 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:11.216201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 22/41] 10.222.0.52 () {60 vars in 1131 bytes} [Sat Sep 17 20:37:10 2022] POST /identity/v3/roles => generated 225 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:11.217857 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd36473-ef95-44f5-84df-61eaee69aec9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:11.330434 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4fc21-3ae4-462a-936b-e0cf00eb6dd7 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:11.350488 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd36473-ef95-44f5-84df-61eaee69aec9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:11.351618 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:11.390637 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d931-9208-400c-bb3d-fc5e4ffcac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:11.391838 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d931-9208-400c-bb3d-fc5e4ffcac94 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:11.392823 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d931-9208-400c-bb3d-fc5e4ffcac94 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:11.393333 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d931-9208-400c-bb3d-fc5e4ffcac94 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:11.394650 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053d931-9208-400c-bb3d-fc5e4ffcac94 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:11.396379 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053d931-9208-400c-bb3d-fc5e4ffcac94 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:11.397798 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d4ac3-df06-4203-a89e-ff6ce272fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:11.398567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d4ac3-df06-4203-a89e-ff6ce272fc56 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:11.399475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d4ac3-df06-4203-a89e-ff6ce272fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:11.400040 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d4ac3-df06-4203-a89e-ff6ce272fc56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:11.401983 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d4ac3-df06-4203-a89e-ff6ce272fc56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:11.403661 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d4ac3-df06-4203-a89e-ff6ce272fc56 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:11.405843 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 23/42] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:11.411885 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d4ac3-df06-4203-a89e-ff6ce272fc56 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:11.487917 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:11.517442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 20/43] 10.222.0.52 () {60 vars in 1131 bytes} [Sat Sep 17 20:37:11 2022] POST /identity/v3/roles => generated 223 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:11.533242 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d931-9208-400c-bb3d-fc5e4ffcac94 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:11.537153 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d4ac3-df06-4203-a89e-ff6ce272fc56 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:11.581675 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac9b8b-57cc-4bf2-93ad-6ab8c2c29c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:11.582382 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac9b8b-57cc-4bf2-93ad-6ab8c2c29c87 None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:11.582664 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac9b8b-57cc-4bf2-93ad-6ab8c2c29c87 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:11.582952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac9b8b-57cc-4bf2-93ad-6ab8c2c29c87 None admin] PATH_INFO: `/v3/domains/default/users/c1b97854cfd447a990a1e65cc1830977/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:11.585461 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac9b8b-57cc-4bf2-93ad-6ab8c2c29c87 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c1b97854cfd447a990a1e65cc1830977, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:11.587547 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac9b8b-57cc-4bf2-93ad-6ab8c2c29c87 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:11.647331 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d931-9208-400c-bb3d-fc5e4ffcac94 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:11.671462 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 24/44] 10.222.0.52 () {58 vars in 1361 bytes} [Sat Sep 17 20:37:11 2022] PUT /identity/v3/domains/default/users/c1b97854cfd447a990a1e65cc1830977/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:37:11.695070 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1300d81-5982-4dc7-95b8-75129f422151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:11.695743 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300d81-5982-4dc7-95b8-75129f422151 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:11.696105 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300d81-5982-4dc7-95b8-75129f422151 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:11.696388 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300d81-5982-4dc7-95b8-75129f422151 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:11.697759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1300d81-5982-4dc7-95b8-75129f422151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:11.699295 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1300d81-5982-4dc7-95b8-75129f422151 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:11.701329 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 21/45] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:11.707076 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac9b8b-57cc-4bf2-93ad-6ab8c2c29c87 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:11.831399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac9b8b-57cc-4bf2-93ad-6ab8c2c29c87 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:11.860776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:11.868830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e845b-420a-4e00-aa4a-2c1c1e68f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:11.869481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e845b-420a-4e00-aa4a-2c1c1e68f2a4 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:11.876841 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e845b-420a-4e00-aa4a-2c1c1e68f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:11.876841 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e845b-420a-4e00-aa4a-2c1c1e68f2a4 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:11.876841 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e845b-420a-4e00-aa4a-2c1c1e68f2a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:11.876841 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e845b-420a-4e00-aa4a-2c1c1e68f2a4 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:11.955717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 25/46] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:37:11 2022] POST /identity/v3/projects => generated 312 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:14.083528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f0d27-410a-4712-98a8-a8de1f905e54 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:14.084032 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f0d27-410a-4712-98a8-a8de1f905e54 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:14.084032 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f0d27-410a-4712-98a8-a8de1f905e54 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:14.085369 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 22/47] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:14.090981 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf303e-ffd0-48b7-90da-c5d1f30469ff None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:14.091386 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf303e-ffd0-48b7-90da-c5d1f30469ff None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:14.091547 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf303e-ffd0-48b7-90da-c5d1f30469ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:14.120390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-2fcf303e-ffd0-48b7-90da-c5d1f30469ff None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:14.122035 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-2fcf303e-ffd0-48b7-90da-c5d1f30469ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:14.188278 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 26/48] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:14.348974 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c880f-1428-4bdc-a97d-1a4726b1053b None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:14.349209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c880f-1428-4bdc-a97d-1a4726b1053b None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:14.349778 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c880f-1428-4bdc-a97d-1a4726b1053b None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:14.351127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 23/49] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:14.356474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820b37-909e-493b-bba7-ee7fc7eb796f None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:14.356769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820b37-909e-493b-bba7-ee7fc7eb796f None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:14.357046 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820b37-909e-493b-bba7-ee7fc7eb796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:14.375348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-80820b37-909e-493b-bba7-ee7fc7eb796f None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:14.376523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-80820b37-909e-493b-bba7-ee7fc7eb796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:14.443307 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 27/50] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:14.530240 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c880f-1428-4bdc-a97d-1a4726b1053b None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:14.578833 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:14.636587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c880f-1428-4bdc-a97d-1a4726b1053b None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:14.669063 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79c168-dde8-407f-b2e8-75a071ce70f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:14.669711 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79c168-dde8-407f-b2e8-75a071ce70f3 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:14.669993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79c168-dde8-407f-b2e8-75a071ce70f3 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:14.670265 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79c168-dde8-407f-b2e8-75a071ce70f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:14.680063 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79c168-dde8-407f-b2e8-75a071ce70f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-6c79c168-dde8-407f-b2e8-75a071ce70f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:14.685853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:14.686664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:14.687445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 24/51] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:37:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:14.693262 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80820b37-909e-493b-bba7-ee7fc7eb796f None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:14.735134 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:14.768726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79c168-dde8-407f-b2e8-75a071ce70f3 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:14.794154 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80820b37-909e-493b-bba7-ee7fc7eb796f None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:14.829949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43760f44-cd5e-4c4a-9605-9012e8f7ea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:14.830562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43760f44-cd5e-4c4a-9605-9012e8f7ea85 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:14.830838 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43760f44-cd5e-4c4a-9605-9012e8f7ea85 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:14.831114 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43760f44-cd5e-4c4a-9605-9012e8f7ea85 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:14.831767 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43760f44-cd5e-4c4a-9605-9012e8f7ea85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:14.832067 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43760f44-cd5e-4c4a-9605-9012e8f7ea85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:14.833469 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43760f44-cd5e-4c4a-9605-9012e8f7ea85 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:14.841466 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 28/52] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:14.847233 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43760f44-cd5e-4c4a-9605-9012e8f7ea85 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:14.872667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79c168-dde8-407f-b2e8-75a071ce70f3 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:14.874178 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:14.907343 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9534b-acbb-4e50-a65c-0376190cfbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:14.907971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9534b-acbb-4e50-a65c-0376190cfbf7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:14.908250 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9534b-acbb-4e50-a65c-0376190cfbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:14.908521 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9534b-acbb-4e50-a65c-0376190cfbf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:14.909651 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9534b-acbb-4e50-a65c-0376190cfbf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:14.911155 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9534b-acbb-4e50-a65c-0376190cfbf7 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:14.912887 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 25/53] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:14.918851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9534b-acbb-4e50-a65c-0376190cfbf7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:14.948423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43760f44-cd5e-4c4a-9605-9012e8f7ea85 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:14.949948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:14.982229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd12cdd-29a1-4b91-bcfd-88220a9241d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:14.982854 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd12cdd-29a1-4b91-bcfd-88220a9241d8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:14.983133 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd12cdd-29a1-4b91-bcfd-88220a9241d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:14.983407 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd12cdd-29a1-4b91-bcfd-88220a9241d8 None admin] PATH_INFO: `/v3/users/c1b97854cfd447a990a1e65cc1830977` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:14.984531 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd12cdd-29a1-4b91-bcfd-88220a9241d8 None admin] RBAC: Authorizing `identity:get_user(user_id=c1b97854cfd447a990a1e65cc1830977)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:14.986013 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd12cdd-29a1-4b91-bcfd-88220a9241d8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:14.987569 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 29/54] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:14 2022] GET /identity/v3/users/c1b97854cfd447a990a1e65cc1830977 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:14.992972 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd12cdd-29a1-4b91-bcfd-88220a9241d8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:15.015117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9534b-acbb-4e50-a65c-0376190cfbf7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:15.049224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfe1a9-9701-4c5e-9165-f157cea9eda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:15.049836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe1a9-9701-4c5e-9165-f157cea9eda4 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:15.050115 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe1a9-9701-4c5e-9165-f157cea9eda4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:15.050384 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe1a9-9701-4c5e-9165-f157cea9eda4 None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:15.051027 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfe1a9-9701-4c5e-9165-f157cea9eda4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:15.052463 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfe1a9-9701-4c5e-9165-f157cea9eda4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:15.093052 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd12cdd-29a1-4b91-bcfd-88220a9241d8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:15.126440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f4cb3-05c1-4f24-8333-8b22e1b64be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:15.127053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4cb3-05c1-4f24-8333-8b22e1b64be5 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:15.127335 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4cb3-05c1-4f24-8333-8b22e1b64be5 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:15.127611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4cb3-05c1-4f24-8333-8b22e1b64be5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:15.128714 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f4cb3-05c1-4f24-8333-8b22e1b64be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:15.130196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f4cb3-05c1-4f24-8333-8b22e1b64be5 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:15.131731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 30/55] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:15.138168 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f4cb3-05c1-4f24-8333-8b22e1b64be5 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:15.181283 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 26/56] 10.222.0.52 () {60 vars in 1140 bytes} [Sat Sep 17 20:37:14 2022] POST /identity/v3/projects => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:37:15.182624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:15.244478 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f4cb3-05c1-4f24-8333-8b22e1b64be5 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:15.281648 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0883b-383a-4b4d-ab41-f27fd7d9945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:15.282262 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0883b-383a-4b4d-ab41-f27fd7d9945f None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:15.282545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0883b-383a-4b4d-ab41-f27fd7d9945f None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:15.282818 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0883b-383a-4b4d-ab41-f27fd7d9945f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:15.283552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0883b-383a-4b4d-ab41-f27fd7d9945f None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.domain.id=default, user.id=c1b97854cfd447a990a1e65cc1830977) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:15.283859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0883b-383a-4b4d-ab41-f27fd7d9945f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:15.285338 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0883b-383a-4b4d-ab41-f27fd7d9945f None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:15.294427 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 31/57] 10.222.0.52 () {56 vars in 1322 bytes} [Sat Sep 17 20:37:15 2022] GET /identity/v3/role_assignments?user.id=c1b97854cfd447a990a1e65cc1830977&scope.domain.id=default&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:17.603338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cd239-8353-43c2-a6f4-a8bf02f272e6 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:17.603889 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cd239-8353-43c2-a6f4-a8bf02f272e6 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:17.603889 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cd239-8353-43c2-a6f4-a8bf02f272e6 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:17.605227 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 27/58] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:17.610489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d979d-a0ae-4155-a7f6-0f704a652325 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:17.610854 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d979d-a0ae-4155-a7f6-0f704a652325 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:17.611037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d979d-a0ae-4155-a7f6-0f704a652325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:17.628717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-383d979d-a0ae-4155-a7f6-0f704a652325 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:17.629942 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-383d979d-a0ae-4155-a7f6-0f704a652325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:17.694529 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 32/59] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:18.021081 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cd239-8353-43c2-a6f4-a8bf02f272e6 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:18.045833 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:18.121065 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cd239-8353-43c2-a6f4-a8bf02f272e6 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:18.167777 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1270d73-76c2-4c83-a967-e8d76df240d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:18.168396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1270d73-76c2-4c83-a967-e8d76df240d3 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:18.168675 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1270d73-76c2-4c83-a967-e8d76df240d3 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:18.168996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1270d73-76c2-4c83-a967-e8d76df240d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:18.170120 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1270d73-76c2-4c83-a967-e8d76df240d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:18.172048 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1270d73-76c2-4c83-a967-e8d76df240d3 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:18.174443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 28/60] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:18.180077 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d979d-a0ae-4155-a7f6-0f704a652325 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:18.209651 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:18.276861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d979d-a0ae-4155-a7f6-0f704a652325 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:18.309896 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e0368-8cde-4db5-8e8e-d7f6fb6bb62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:18.310493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0368-8cde-4db5-8e8e-d7f6fb6bb62a None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:18.310775 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0368-8cde-4db5-8e8e-d7f6fb6bb62a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:18.311047 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0368-8cde-4db5-8e8e-d7f6fb6bb62a None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:18.311685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e0368-8cde-4db5-8e8e-d7f6fb6bb62a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:18.313112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e0368-8cde-4db5-8e8e-d7f6fb6bb62a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:18.428358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 33/61] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:37:18 2022] POST /identity/v3/users => generated 275 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:22.095206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b162460-8491-493c-a28b-7cb7cb9e1832 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:22.096175 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b162460-8491-493c-a28b-7cb7cb9e1832 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:22.096654 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b162460-8491-493c-a28b-7cb7cb9e1832 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:22.098232 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 29/62] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:22.109711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e740a21-7d46-407e-85cf-44336e300105 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:22.110583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e740a21-7d46-407e-85cf-44336e300105 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:22.111072 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e740a21-7d46-407e-85cf-44336e300105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:22.138185 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-3e740a21-7d46-407e-85cf-44336e300105 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:22.139743 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-3e740a21-7d46-407e-85cf-44336e300105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:22.231402 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 34/63] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:22.290601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2faa-f47f-49e8-8699-66e5786f8f33 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:22.291466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2faa-f47f-49e8-8699-66e5786f8f33 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:22.292029 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2faa-f47f-49e8-8699-66e5786f8f33 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:22.293618 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 30/64] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:22.299178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c13b7-a36c-46c9-a8f6-c75c78d627c7 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:22.299709 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c13b7-a36c-46c9-a8f6-c75c78d627c7 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:22.300185 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c13b7-a36c-46c9-a8f6-c75c78d627c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:22.319427 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-795c13b7-a36c-46c9-a8f6-c75c78d627c7 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:22.320963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-795c13b7-a36c-46c9-a8f6-c75c78d627c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:22.343692 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:22.420776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 35/65] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:22.430223 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757463e1-43ff-43b5-a9ca-b48596d6c5e2 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:22.430511 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757463e1-43ff-43b5-a9ca-b48596d6c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:22.430844 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757463e1-43ff-43b5-a9ca-b48596d6c5e2 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:22.432866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 31/66] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:22.451752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f9053-62a9-4a75-8ef9-fb0cef308abf None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:22.457808 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f9053-62a9-4a75-8ef9-fb0cef308abf None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:22.457808 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f9053-62a9-4a75-8ef9-fb0cef308abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:22.476956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-dc8f9053-62a9-4a75-8ef9-fb0cef308abf None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:22.478988 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-dc8f9053-62a9-4a75-8ef9-fb0cef308abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:22.559073 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 36/67] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:22.667906 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796617b-e29d-43d4-aff8-708eb6e529df None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:22.668308 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796617b-e29d-43d4-aff8-708eb6e529df None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:22.668592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796617b-e29d-43d4-aff8-708eb6e529df None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:22.670090 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 32/68] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:22.671907 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f9053-62a9-4a75-8ef9-fb0cef308abf None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:22.674698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44670a-48ed-42c6-85ce-f7c1eae51a53 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:22.675161 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44670a-48ed-42c6-85ce-f7c1eae51a53 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:22.675607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44670a-48ed-42c6-85ce-f7c1eae51a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:22.703154 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-fe44670a-48ed-42c6-85ce-f7c1eae51a53 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:22.705820 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-fe44670a-48ed-42c6-85ce-f7c1eae51a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:22.789776 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 33/69] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:22.820288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:22.843984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f9053-62a9-4a75-8ef9-fb0cef308abf None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:22.861098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44670a-48ed-42c6-85ce-f7c1eae51a53 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:22.887256 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:22.899398 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067cff5-8976-4db2-9866-d2f1a57120e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:22.902506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067cff5-8976-4db2-9866-d2f1a57120e3 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:22.903046 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067cff5-8976-4db2-9866-d2f1a57120e3 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:22.903539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067cff5-8976-4db2-9866-d2f1a57120e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:22.925241 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067cff5-8976-4db2-9866-d2f1a57120e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-d067cff5-8976-4db2-9866-d2f1a57120e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:22.933934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:22.934763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:22.935552 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:22.943956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 37/70] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:22.951859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067cff5-8976-4db2-9866-d2f1a57120e3 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.019683 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44670a-48ed-42c6-85ce-f7c1eae51a53 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.054238 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e600f1-32f6-4b30-8b85-0d2c4547602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.054860 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e600f1-32f6-4b30-8b85-0d2c4547602e None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.055136 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e600f1-32f6-4b30-8b85-0d2c4547602e None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.055403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e600f1-32f6-4b30-8b85-0d2c4547602e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.065738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e600f1-32f6-4b30-8b85-0d2c4547602e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-08e600f1-32f6-4b30-8b85-0d2c4547602e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:23.070863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:23.072346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 34/71] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:37:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:23.074046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e600f1-32f6-4b30-8b85-0d2c4547602e None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.085126 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067cff5-8976-4db2-9866-d2f1a57120e3 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.123832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df49089-3c14-4c44-ab08-4304532b83f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.124495 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49089-3c14-4c44-ab08-4304532b83f8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.124719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49089-3c14-4c44-ab08-4304532b83f8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.125030 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49089-3c14-4c44-ab08-4304532b83f8 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.125731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df49089-3c14-4c44-ab08-4304532b83f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:23.126031 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df49089-3c14-4c44-ab08-4304532b83f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:23.127430 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df49089-3c14-4c44-ab08-4304532b83f8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:23.133311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:23.137128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 38/72] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:23.138393 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7014e3-5ecb-4a71-8ef0-99e76a429bba None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.138679 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7014e3-5ecb-4a71-8ef0-99e76a429bba None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.138952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7014e3-5ecb-4a71-8ef0-99e76a429bba None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.144169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 39/73] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:23.144936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7014e3-5ecb-4a71-8ef0-99e76a429bba None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.167300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:23.185152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e600f1-32f6-4b30-8b85-0d2c4547602e None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.220639 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ff3a-bfb3-44d3-a4b2-9699430cf5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.221294 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ff3a-bfb3-44d3-a4b2-9699430cf5e2 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.221549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ff3a-bfb3-44d3-a4b2-9699430cf5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.221822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ff3a-bfb3-44d3-a4b2-9699430cf5e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.231781 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2ff3a-bfb3-44d3-a4b2-9699430cf5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-6eb2ff3a-bfb3-44d3-a4b2-9699430cf5e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:23.236625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:23.237531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:23.238314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 35/74] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:23.238941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ff3a-bfb3-44d3-a4b2-9699430cf5e2 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.250331 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7014e3-5ecb-4a71-8ef0-99e76a429bba None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.284492 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f96116-1a0c-41f8-a9e0-15b3a568ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.285099 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96116-1a0c-41f8-a9e0-15b3a568ade9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.285418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96116-1a0c-41f8-a9e0-15b3a568ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.285694 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96116-1a0c-41f8-a9e0-15b3a568ade9 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.286358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f96116-1a0c-41f8-a9e0-15b3a568ade9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:23.286664 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f96116-1a0c-41f8-a9e0-15b3a568ade9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:23.288057 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f96116-1a0c-41f8-a9e0-15b3a568ade9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:23.296617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 40/75] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:23.297788 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9abb2-e5aa-4b71-9dbc-9ceb5a812056 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.298081 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9abb2-e5aa-4b71-9dbc-9ceb5a812056 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.298357 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9abb2-e5aa-4b71-9dbc-9ceb5a812056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.316206 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-d0d9abb2-e5aa-4b71-9dbc-9ceb5a812056 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:23.317715 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-d0d9abb2-e5aa-4b71-9dbc-9ceb5a812056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:23.342022 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ff3a-bfb3-44d3-a4b2-9699430cf5e2 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.374237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:23.375517 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951ba9b-3629-42ba-99b8-0fdcfa1df325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.376141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ba9b-3629-42ba-99b8-0fdcfa1df325 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.376425 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ba9b-3629-42ba-99b8-0fdcfa1df325 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.376696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ba9b-3629-42ba-99b8-0fdcfa1df325 None admin] PATH_INFO: `/v3/users/fdf274baf5444ff3b62a655abb478066` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.384063 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 41/76] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:23.385042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9abb2-e5aa-4b71-9dbc-9ceb5a812056 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.387747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:23.391145 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951ba9b-3629-42ba-99b8-0fdcfa1df325 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf274baf5444ff3b62a655abb478066)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:23.392670 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951ba9b-3629-42ba-99b8-0fdcfa1df325 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:23.394990 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 36/77] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/users/fdf274baf5444ff3b62a655abb478066 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:23.395181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951ba9b-3629-42ba-99b8-0fdcfa1df325 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.498620 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9abb2-e5aa-4b71-9dbc-9ceb5a812056 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.500890 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951ba9b-3629-42ba-99b8-0fdcfa1df325 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.535391 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38648f-4b81-49e4-8594-538201df30de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.535996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38648f-4b81-49e4-8594-538201df30de None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.536274 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38648f-4b81-49e4-8594-538201df30de None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.536542 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38648f-4b81-49e4-8594-538201df30de None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.537207 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38648f-4b81-49e4-8594-538201df30de None admin] RBAC: Adding query filter params (name=admin) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:23.537519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38648f-4b81-49e4-8594-538201df30de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:23.538781 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16efe4f-5d21-448e-9b62-eceb49e46f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.538909 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38648f-4b81-49e4-8594-538201df30de None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:23.539407 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16efe4f-5d21-448e-9b62-eceb49e46f97 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.539682 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16efe4f-5d21-448e-9b62-eceb49e46f97 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.539954 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16efe4f-5d21-448e-9b62-eceb49e46f97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.547680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 37/78] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:23.548311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38648f-4b81-49e4-8594-538201df30de None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.557136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16efe4f-5d21-448e-9b62-eceb49e46f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-a16efe4f-5d21-448e-9b62-eceb49e46f97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:23.561725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:23.562576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:23.563312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 42/79] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:23.568409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16efe4f-5d21-448e-9b62-eceb49e46f97 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.613521 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:23.625107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:23.656055 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38648f-4b81-49e4-8594-538201df30de None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.672487 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16efe4f-5d21-448e-9b62-eceb49e46f97 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.689264 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfa475-a38a-444d-a192-8becd835a1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.689895 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfa475-a38a-444d-a192-8becd835a1f4 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.690174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfa475-a38a-444d-a192-8becd835a1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.690444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfa475-a38a-444d-a192-8becd835a1f4 None admin] PATH_INFO: `/v3/users/fdf274baf5444ff3b62a655abb478066` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.691569 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfa475-a38a-444d-a192-8becd835a1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf274baf5444ff3b62a655abb478066)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:23.693351 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfa475-a38a-444d-a192-8becd835a1f4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:23.695066 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 38/80] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/users/fdf274baf5444ff3b62a655abb478066 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:23.695646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfa475-a38a-444d-a192-8becd835a1f4 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.715908 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9fb47-f4b4-4fdc-a195-883f48580b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.716678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9fb47-f4b4-4fdc-a195-883f48580b8c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.716960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9fb47-f4b4-4fdc-a195-883f48580b8c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.717267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9fb47-f4b4-4fdc-a195-883f48580b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.785938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9fb47-f4b4-4fdc-a195-883f48580b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:23.787332 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9fb47-f4b4-4fdc-a195-883f48580b8c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:23.799977 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfa475-a38a-444d-a192-8becd835a1f4 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.829046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:23.836872 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a0b59-6220-41c2-ae4b-3d3c585ca148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.838324 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a0b59-6220-41c2-ae4b-3d3c585ca148 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.838604 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a0b59-6220-41c2-ae4b-3d3c585ca148 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.856968 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a0b59-6220-41c2-ae4b-3d3c585ca148 None admin] PATH_INFO: `/v3/users/c1b97854cfd447a990a1e65cc1830977` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.856968 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a0b59-6220-41c2-ae4b-3d3c585ca148 None admin] RBAC: Authorizing `identity:get_user(user_id=c1b97854cfd447a990a1e65cc1830977)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:23.857155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:23.857274 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a0b59-6220-41c2-ae4b-3d3c585ca148 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:23.857274 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 39/81] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/users/c1b97854cfd447a990a1e65cc1830977 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:23.857274 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a0b59-6220-41c2-ae4b-3d3c585ca148 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.886818 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 43/82] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:23.887915 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9fb47-f4b4-4fdc-a195-883f48580b8c None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:23.949677 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a0b59-6220-41c2-ae4b-3d3c585ca148 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.983728 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99871d-7c6e-4e2b-99b4-1a5fd5f6bd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:23.984333 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99871d-7c6e-4e2b-99b4-1a5fd5f6bd27 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:23.984618 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99871d-7c6e-4e2b-99b4-1a5fd5f6bd27 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:23.984896 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99871d-7c6e-4e2b-99b4-1a5fd5f6bd27 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:23.985018 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9fb47-f4b4-4fdc-a195-883f48580b8c None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:23.985591 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99871d-7c6e-4e2b-99b4-1a5fd5f6bd27 None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:23.985901 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99871d-7c6e-4e2b-99b4-1a5fd5f6bd27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:23.987300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99871d-7c6e-4e2b-99b4-1a5fd5f6bd27 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:23.995299 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 40/83] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:23.996174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99871d-7c6e-4e2b-99b4-1a5fd5f6bd27 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.020514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660b3d0-0cb1-4969-a9f8-949cd2eb7bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:24.021092 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660b3d0-0cb1-4969-a9f8-949cd2eb7bdd None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:24.021404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660b3d0-0cb1-4969-a9f8-949cd2eb7bdd None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:24.021674 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660b3d0-0cb1-4969-a9f8-949cd2eb7bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:24.048570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:24.056241 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:24.089490 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660b3d0-0cb1-4969-a9f8-949cd2eb7bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:24.091384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660b3d0-0cb1-4969-a9f8-949cd2eb7bdd None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:24.098128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99871d-7c6e-4e2b-99b4-1a5fd5f6bd27 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:24.132065 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7991bd-22dc-4b20-82a3-290492d41652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:24.132693 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7991bd-22dc-4b20-82a3-290492d41652 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:24.132981 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7991bd-22dc-4b20-82a3-290492d41652 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:24.133296 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7991bd-22dc-4b20-82a3-290492d41652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:24.135524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7991bd-22dc-4b20-82a3-290492d41652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:24.137364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7991bd-22dc-4b20-82a3-290492d41652 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:24.143396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 41/84] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:24.143396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7991bd-22dc-4b20-82a3-290492d41652 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.201842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 44/85] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:24.202927 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660b3d0-0cb1-4969-a9f8-949cd2eb7bdd None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.255744 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7991bd-22dc-4b20-82a3-290492d41652 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:24.256650 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:24.285709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:24.295358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876eac-5f34-4a06-9ff4-8c23288e3dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:24.296078 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876eac-5f34-4a06-9ff4-8c23288e3dbb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:24.296365 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876eac-5f34-4a06-9ff4-8c23288e3dbb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:24.296639 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876eac-5f34-4a06-9ff4-8c23288e3dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:24.309453 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660b3d0-0cb1-4969-a9f8-949cd2eb7bdd None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:24.343843 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebdd69-2f46-4709-ab58-9d03c6463bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:24.344464 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebdd69-2f46-4709-ab58-9d03c6463bc6 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:24.344742 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebdd69-2f46-4709-ab58-9d03c6463bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:24.345014 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebdd69-2f46-4709-ab58-9d03c6463bc6 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:24.346164 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebdd69-2f46-4709-ab58-9d03c6463bc6 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:24.347597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebdd69-2f46-4709-ab58-9d03c6463bc6 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:24.349220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 45/86] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:24 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:24.355206 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebdd69-2f46-4709-ab58-9d03c6463bc6 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.365547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e876eac-5f34-4a06-9ff4-8c23288e3dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:24.367049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e876eac-5f34-4a06-9ff4-8c23288e3dbb None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:24.452379 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebdd69-2f46-4709-ab58-9d03c6463bc6 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:24.462699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 42/87] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:24.463619 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876eac-5f34-4a06-9ff4-8c23288e3dbb None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.472684 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:24.486521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5696492-179b-4677-abe5-f6abcaee87c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:24.496094 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5696492-179b-4677-abe5-f6abcaee87c5 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:24.496094 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5696492-179b-4677-abe5-f6abcaee87c5 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:24.496094 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5696492-179b-4677-abe5-f6abcaee87c5 None admin] PATH_INFO: `/v3/users/fdf274baf5444ff3b62a655abb478066` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:24.496094 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5696492-179b-4677-abe5-f6abcaee87c5 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf274baf5444ff3b62a655abb478066)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:24.496376 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:24.496464 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5696492-179b-4677-abe5-f6abcaee87c5 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:24.496464 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 46/88] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:24 2022] GET /identity/v3/users/fdf274baf5444ff3b62a655abb478066 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:24.496464 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5696492-179b-4677-abe5-f6abcaee87c5 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.563147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876eac-5f34-4a06-9ff4-8c23288e3dbb None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:24.591922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5696492-179b-4677-abe5-f6abcaee87c5 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:24.596290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790795a-5f2f-4e17-827a-a894d8d1f368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:24.596892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790795a-5f2f-4e17-827a-a894d8d1f368 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:24.597190 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790795a-5f2f-4e17-827a-a894d8d1f368 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:24.597475 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790795a-5f2f-4e17-827a-a894d8d1f368 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:24.598116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790795a-5f2f-4e17-827a-a894d8d1f368 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:24.599560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790795a-5f2f-4e17-827a-a894d8d1f368 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:24.624579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d8f4f-d01f-43d1-acbd-1e7448563bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:24.625219 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d8f4f-d01f-43d1-acbd-1e7448563bea None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:24.625499 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d8f4f-d01f-43d1-acbd-1e7448563bea None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:24.625772 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d8f4f-d01f-43d1-acbd-1e7448563bea None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:24.626870 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d8f4f-d01f-43d1-acbd-1e7448563bea None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:24.628285 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d8f4f-d01f-43d1-acbd-1e7448563bea None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:24.629916 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 47/89] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:24 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:24.630670 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d8f4f-d01f-43d1-acbd-1e7448563bea None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.680598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 43/90] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:37:24 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:24.682602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790795a-5f2f-4e17-827a-a894d8d1f368 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.685483 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:24.738217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d8f4f-d01f-43d1-acbd-1e7448563bea None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:24.775957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496f44-76e7-449c-826a-5b54be8b8ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:24.776570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496f44-76e7-449c-826a-5b54be8b8ee6 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:24.776864 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496f44-76e7-449c-826a-5b54be8b8ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:24.777123 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496f44-76e7-449c-826a-5b54be8b8ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:24.777875 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496f44-76e7-449c-826a-5b54be8b8ee6 None admin] RBAC: Adding query filter params (role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=db23ab1161614bd8b0da96131a1fd283, user.id=fdf274baf5444ff3b62a655abb478066) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:24.778177 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496f44-76e7-449c-826a-5b54be8b8ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:24.779553 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:24.779670 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496f44-76e7-449c-826a-5b54be8b8ee6 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:24.794170 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 48/91] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:24 2022] GET /identity/v3/role_assignments?user.id=fdf274baf5444ff3b62a655abb478066&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:24.794170 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496f44-76e7-449c-826a-5b54be8b8ee6 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.821502 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790795a-5f2f-4e17-827a-a894d8d1f368 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:24.870546 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf5359-0c83-41eb-a3e2-06fbbb0857f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:24.871439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf5359-0c83-41eb-a3e2-06fbbb0857f7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:24.871842 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf5359-0c83-41eb-a3e2-06fbbb0857f7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:24.872283 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf5359-0c83-41eb-a3e2-06fbbb0857f7 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:24.873822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf5359-0c83-41eb-a3e2-06fbbb0857f7 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:24.875456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf5359-0c83-41eb-a3e2-06fbbb0857f7 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:24.877582 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 44/92] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:24 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:24.878547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf5359-0c83-41eb-a3e2-06fbbb0857f7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:24.957850 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496f44-76e7-449c-826a-5b54be8b8ee6 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:24.981615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:25.009200 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf5359-0c83-41eb-a3e2-06fbbb0857f7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:25.012416 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745dc14-8753-4c20-9a5d-0929e34dcbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:25.013040 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745dc14-8753-4c20-9a5d-0929e34dcbdc None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:25.013446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745dc14-8753-4c20-9a5d-0929e34dcbdc None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:25.013822 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745dc14-8753-4c20-9a5d-0929e34dcbdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:25.057968 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ef651-b07f-41c1-90e2-f319967bdc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:25.058591 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ef651-b07f-41c1-90e2-f319967bdc71 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:25.058871 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ef651-b07f-41c1-90e2-f319967bdc71 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:25.059148 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ef651-b07f-41c1-90e2-f319967bdc71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:25.059929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ef651-b07f-41c1-90e2-f319967bdc71 None admin] RBAC: Adding query filter params (role.id=1245a77a23c14542b165310facdab5cd, scope.project.id=db23ab1161614bd8b0da96131a1fd283, user.id=fdf274baf5444ff3b62a655abb478066) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:25.060188 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ef651-b07f-41c1-90e2-f319967bdc71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:25.061954 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ef651-b07f-41c1-90e2-f319967bdc71 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:25.068926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 45/93] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:24 2022] GET /identity/v3/role_assignments?user.id=fdf274baf5444ff3b62a655abb478066&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=1245a77a23c14542b165310facdab5cd => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:25.069672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ef651-b07f-41c1-90e2-f319967bdc71 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:25.089630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:25.109737 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745dc14-8753-4c20-9a5d-0929e34dcbdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:25.111500 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745dc14-8753-4c20-9a5d-0929e34dcbdc None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:25.208800 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ef651-b07f-41c1-90e2-f319967bdc71 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:25.283716 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f112f-ab79-4742-836e-72074b3af1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:25.285275 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f112f-ab79-4742-836e-72074b3af1fb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:25.286415 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f112f-ab79-4742-836e-72074b3af1fb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:25.287020 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f112f-ab79-4742-836e-72074b3af1fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:25.289121 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f112f-ab79-4742-836e-72074b3af1fb None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=db23ab1161614bd8b0da96131a1fd283, user.id=c1b97854cfd447a990a1e65cc1830977) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:25.289850 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f112f-ab79-4742-836e-72074b3af1fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:25.292736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f112f-ab79-4742-836e-72074b3af1fb None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:25.299611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 49/94] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:25.304373 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 46/95] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:25 2022] GET /identity/v3/role_assignments?user.id=c1b97854cfd447a990a1e65cc1830977&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:25.305871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745dc14-8753-4c20-9a5d-0929e34dcbdc None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:25.333331 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:25.482174 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745dc14-8753-4c20-9a5d-0929e34dcbdc None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:25.534481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194fe24-b937-40ac-ab04-8bb635d6623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:25.535367 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194fe24-b937-40ac-ab04-8bb635d6623b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:25.535812 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194fe24-b937-40ac-ab04-8bb635d6623b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:25.536224 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194fe24-b937-40ac-ab04-8bb635d6623b None admin] PATH_INFO: `/v3/projects/ebbe0d505b044dfb991a21b7e6cde5b5` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:25.537539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194fe24-b937-40ac-ab04-8bb635d6623b None admin] RBAC: Authorizing `identity:get_project(project_id=ebbe0d505b044dfb991a21b7e6cde5b5)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:25.539257 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194fe24-b937-40ac-ab04-8bb635d6623b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:25.541634 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 50/96] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:25 2022] GET /identity/v3/projects/ebbe0d505b044dfb991a21b7e6cde5b5 => generated 312 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:25.547866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f112f-ab79-4742-836e-72074b3af1fb None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:25.651873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:25.675476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f112f-ab79-4742-836e-72074b3af1fb None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:25.714202 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654df86-03fe-41db-bf8e-f151d3975abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:25.714812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654df86-03fe-41db-bf8e-f151d3975abb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:25.715088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654df86-03fe-41db-bf8e-f151d3975abb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:25.715360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654df86-03fe-41db-bf8e-f151d3975abb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:25.716146 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654df86-03fe-41db-bf8e-f151d3975abb None admin] RBAC: Adding query filter params (role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=ebbe0d505b044dfb991a21b7e6cde5b5, user.id=fdf274baf5444ff3b62a655abb478066) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:25.716455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654df86-03fe-41db-bf8e-f151d3975abb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:25.717928 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654df86-03fe-41db-bf8e-f151d3975abb None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:25.727850 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 47/97] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:25 2022] GET /identity/v3/role_assignments?user.id=fdf274baf5444ff3b62a655abb478066&scope.project.id=ebbe0d505b044dfb991a21b7e6cde5b5&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:28.348805 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f272a-8aad-4299-a401-c555d436b37a None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:28.349358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f272a-8aad-4299-a401-c555d436b37a None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:28.349358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f272a-8aad-4299-a401-c555d436b37a None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:28.350963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 51/98] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:28.356931 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25ac5-47b1-46a7-9b88-238a6910ad1e None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:28.357400 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25ac5-47b1-46a7-9b88-238a6910ad1e None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:28.357574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25ac5-47b1-46a7-9b88-238a6910ad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:28.386400 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-4fb25ac5-47b1-46a7-9b88-238a6910ad1e None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:28.387678 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-4fb25ac5-47b1-46a7-9b88-238a6910ad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:28.499777 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe8468-dd74-4ab8-bb45-4a4d48777962 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:28.500118 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe8468-dd74-4ab8-bb45-4a4d48777962 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:28.500337 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe8468-dd74-4ab8-bb45-4a4d48777962 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:28.502013 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 52/99] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:37:28.507712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2836f-f318-4284-8750-c5e554e919ce None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:28.507995 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2836f-f318-4284-8750-c5e554e919ce None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:28.508273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2836f-f318-4284-8750-c5e554e919ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:28.543509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-1fe2836f-f318-4284-8750-c5e554e919ce None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:28.544759 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-1fe2836f-f318-4284-8750-c5e554e919ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:28.597086 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 48/100] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:28.663850 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 53/101] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:28.826996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08c03e-7cd1-45c3-a190-52b72d6273fc None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:28.827276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08c03e-7cd1-45c3-a190-52b72d6273fc None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:28.827557 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08c03e-7cd1-45c3-a190-52b72d6273fc None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:28.829006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 49/102] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:28.842201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43b5c6-e358-4591-9c90-913ce56cdcae None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:28.842486 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43b5c6-e358-4591-9c90-913ce56cdcae None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:28.842766 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43b5c6-e358-4591-9c90-913ce56cdcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:28.869316 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-6f43b5c6-e358-4591-9c90-913ce56cdcae None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:28.870507 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-6f43b5c6-e358-4591-9c90-913ce56cdcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:28.884518 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:28.953856 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 54/103] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:28.970726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40f7c4-5d22-4f7e-b6a6-cfc18445f8cf None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:28.971014 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40f7c4-5d22-4f7e-b6a6-cfc18445f8cf None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:28.971298 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40f7c4-5d22-4f7e-b6a6-cfc18445f8cf None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:28.972747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 50/104] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:28.977824 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3f861-7791-4a54-921a-7322fe26ebb2 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:28.978193 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3f861-7791-4a54-921a-7322fe26ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:28.978479 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3f861-7791-4a54-921a-7322fe26ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.006210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-bfa3f861-7791-4a54-921a-7322fe26ebb2 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:29.007405 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-bfa3f861-7791-4a54-921a-7322fe26ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:29.079000 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40f7c4-5d22-4f7e-b6a6-cfc18445f8cf None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:29.101912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 55/105] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:29.173090 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3f861-7791-4a54-921a-7322fe26ebb2 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:29.182022 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:29.216153 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40f7c4-5d22-4f7e-b6a6-cfc18445f8cf None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:29.256247 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a27ce-a6ba-4569-904f-8cef284e849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:29.257278 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a27ce-a6ba-4569-904f-8cef284e849c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.257852 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a27ce-a6ba-4569-904f-8cef284e849c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.259878 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a27ce-a6ba-4569-904f-8cef284e849c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.271286 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a27ce-a6ba-4569-904f-8cef284e849c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-a02a27ce-a6ba-4569-904f-8cef284e849c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:29.278334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:29.279209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:29.279993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:29.282952 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 51/106] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:37:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:37:29.290875 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847924e-b031-42c7-91d3-1158096ff44d None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.291462 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847924e-b031-42c7-91d3-1158096ff44d None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.293671 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847924e-b031-42c7-91d3-1158096ff44d None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.293671 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 52/107] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:29.294812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847924e-b031-42c7-91d3-1158096ff44d None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:29.364775 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:29.409340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3f861-7791-4a54-921a-7322fe26ebb2 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:29.450866 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7e82a-f6cc-45f7-a41d-3dc347437863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:29.451385 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847924e-b031-42c7-91d3-1158096ff44d None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:29.451816 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7e82a-f6cc-45f7-a41d-3dc347437863 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.451889 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7e82a-f6cc-45f7-a41d-3dc347437863 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.452223 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7e82a-f6cc-45f7-a41d-3dc347437863 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.453409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7e82a-f6cc-45f7-a41d-3dc347437863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:29.454911 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7e82a-f6cc-45f7-a41d-3dc347437863 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:29.456740 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 56/108] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:29.457727 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff236e3-2871-4eed-ac77-2d30a50e994c None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.458076 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff236e3-2871-4eed-ac77-2d30a50e994c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.458416 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff236e3-2871-4eed-ac77-2d30a50e994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.476343 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-fff236e3-2871-4eed-ac77-2d30a50e994c None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:29.477601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-fff236e3-2871-4eed-ac77-2d30a50e994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:29.486641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:29.492183 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8351270-26db-478d-a012-4c7b7a3b5ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:29.493715 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8351270-26db-478d-a012-4c7b7a3b5ccb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.494180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8351270-26db-478d-a012-4c7b7a3b5ccb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.498802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8351270-26db-478d-a012-4c7b7a3b5ccb None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.498802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8351270-26db-478d-a012-4c7b7a3b5ccb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:29.498802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8351270-26db-478d-a012-4c7b7a3b5ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:29.498802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8351270-26db-478d-a012-4c7b7a3b5ccb None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:29.508904 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 53/109] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:37:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:29.510709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4b087-8ed9-4fdd-84b2-90f189eaa991 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.511002 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4b087-8ed9-4fdd-84b2-90f189eaa991 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.511260 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4b087-8ed9-4fdd-84b2-90f189eaa991 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.512917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 54/110] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:29.513572 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4b087-8ed9-4fdd-84b2-90f189eaa991 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:29.549502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 57/111] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:29.561355 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff236e3-2871-4eed-ac77-2d30a50e994c None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:29.631356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:29.635840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4b087-8ed9-4fdd-84b2-90f189eaa991 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:29.656475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff236e3-2871-4eed-ac77-2d30a50e994c None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:29.671430 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ba97e-0ce1-4dd0-a5ea-43a87c5ccbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:29.672057 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba97e-0ce1-4dd0-a5ea-43a87c5ccbd9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.672340 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba97e-0ce1-4dd0-a5ea-43a87c5ccbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.672625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba97e-0ce1-4dd0-a5ea-43a87c5ccbd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.682985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ba97e-0ce1-4dd0-a5ea-43a87c5ccbd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-331ba97e-0ce1-4dd0-a5ea-43a87c5ccbd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:29.688465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:29.689335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 55/112] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:29.690584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ba97e-0ce1-4dd0-a5ea-43a87c5ccbd9 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:29.697695 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25b05d-518d-421b-9758-cc9ef2920b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:29.698304 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25b05d-518d-421b-9758-cc9ef2920b9a None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.698583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25b05d-518d-421b-9758-cc9ef2920b9a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.698854 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25b05d-518d-421b-9758-cc9ef2920b9a None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.699496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25b05d-518d-421b-9758-cc9ef2920b9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:29.700942 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25b05d-518d-421b-9758-cc9ef2920b9a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:29.746152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:29.791635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ba97e-0ce1-4dd0-a5ea-43a87c5ccbd9 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:29.792441 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 58/113] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:37:29 2022] POST /identity/v3/projects => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:29.801554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25b05d-518d-421b-9758-cc9ef2920b9a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:29.841761 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61066a-9fe0-4782-b6e1-da64f940fe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:29.842465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61066a-9fe0-4782-b6e1-da64f940fe8c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.842745 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61066a-9fe0-4782-b6e1-da64f940fe8c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.843198 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61066a-9fe0-4782-b6e1-da64f940fe8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.858499 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61066a-9fe0-4782-b6e1-da64f940fe8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-ce61066a-9fe0-4782-b6e1-da64f940fe8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:29.866774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:29.867821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:29.870674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 56/114] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:37:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:29.870674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98b10-a9d9-4c35-af13-5eaab67debff None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:29.870674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98b10-a9d9-4c35-af13-5eaab67debff None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:29.870674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98b10-a9d9-4c35-af13-5eaab67debff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:29.892855 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-b1f98b10-a9d9-4c35-af13-5eaab67debff None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:29.894119 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-b1f98b10-a9d9-4c35-af13-5eaab67debff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:29.952636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25b05d-518d-421b-9758-cc9ef2920b9a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:29.972057 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 57/115] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:29.973367 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98b10-a9d9-4c35-af13-5eaab67debff None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:29.996966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:30.007059 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac3af9-4694-488b-a16d-7e2e37f6754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.008138 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac3af9-4694-488b-a16d-7e2e37f6754e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.008425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac3af9-4694-488b-a16d-7e2e37f6754e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.008846 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac3af9-4694-488b-a16d-7e2e37f6754e None admin] PATH_INFO: `/v3/users/fdf274baf5444ff3b62a655abb478066` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.010970 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac3af9-4694-488b-a16d-7e2e37f6754e None admin] RBAC: Authorizing `identity:get_user(user_id=fdf274baf5444ff3b62a655abb478066)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:30.017386 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac3af9-4694-488b-a16d-7e2e37f6754e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:30.017386 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 59/116] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:29 2022] GET /identity/v3/users/fdf274baf5444ff3b62a655abb478066 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:30.018376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac3af9-4694-488b-a16d-7e2e37f6754e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.031358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:30.098543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98b10-a9d9-4c35-af13-5eaab67debff None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.148911 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac3af9-4694-488b-a16d-7e2e37f6754e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.151986 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942356bf-22d8-4632-b674-923c4044dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.152602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942356bf-22d8-4632-b674-923c4044dc31 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.152885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942356bf-22d8-4632-b674-923c4044dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.153179 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942356bf-22d8-4632-b674-923c4044dc31 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.153850 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942356bf-22d8-4632-b674-923c4044dc31 None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:30.154157 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942356bf-22d8-4632-b674-923c4044dc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:30.155547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942356bf-22d8-4632-b674-923c4044dc31 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:30.171524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 58/117] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:30.172941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942356bf-22d8-4632-b674-923c4044dc31 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.201774 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62502f1b-05f5-4187-8211-8412f0ea1319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.202951 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502f1b-05f5-4187-8211-8412f0ea1319 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.203659 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502f1b-05f5-4187-8211-8412f0ea1319 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.204115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502f1b-05f5-4187-8211-8412f0ea1319 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.222237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62502f1b-05f5-4187-8211-8412f0ea1319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-62502f1b-05f5-4187-8211-8412f0ea1319 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:30.227966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:30.228993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 60/118] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:30.230922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62502f1b-05f5-4187-8211-8412f0ea1319 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.302040 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:30.307635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942356bf-22d8-4632-b674-923c4044dc31 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.317611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:30.345777 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7e7d5-ab63-4345-a11a-1db78ea926c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.346392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7e7d5-ab63-4345-a11a-1db78ea926c1 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.346673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7e7d5-ab63-4345-a11a-1db78ea926c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.346950 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7e7d5-ab63-4345-a11a-1db78ea926c1 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.347635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7e7d5-ab63-4345-a11a-1db78ea926c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:30.348001 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7e7d5-ab63-4345-a11a-1db78ea926c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:30.349410 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7e7d5-ab63-4345-a11a-1db78ea926c1 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:30.351109 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62502f1b-05f5-4187-8211-8412f0ea1319 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.358086 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 59/119] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:30.358847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7e7d5-ab63-4345-a11a-1db78ea926c1 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.389258 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665b858-8a95-4ddd-832e-82065060e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.389903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665b858-8a95-4ddd-832e-82065060e4fb None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.390187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665b858-8a95-4ddd-832e-82065060e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.390467 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665b858-8a95-4ddd-832e-82065060e4fb None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.391597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665b858-8a95-4ddd-832e-82065060e4fb None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:30.393062 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665b858-8a95-4ddd-832e-82065060e4fb None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:30.399449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 61/120] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:30.399449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665b858-8a95-4ddd-832e-82065060e4fb None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.475446 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7e7d5-ab63-4345-a11a-1db78ea926c1 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.504239 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665b858-8a95-4ddd-832e-82065060e4fb None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.513336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553eef2-38d6-4249-a6a1-d5918215ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.514254 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553eef2-38d6-4249-a6a1-d5918215ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.514866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553eef2-38d6-4249-a6a1-d5918215ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.515145 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553eef2-38d6-4249-a6a1-d5918215ebd1 None admin] PATH_INFO: `/v3/users/fdf274baf5444ff3b62a655abb478066` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.516297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553eef2-38d6-4249-a6a1-d5918215ebd1 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf274baf5444ff3b62a655abb478066)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:30.517802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553eef2-38d6-4249-a6a1-d5918215ebd1 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:30.519398 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 60/121] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/users/fdf274baf5444ff3b62a655abb478066 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:30.522049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553eef2-38d6-4249-a6a1-d5918215ebd1 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.534455 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:30.546198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52813c-9a98-432b-8160-ad51e7005c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.547044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52813c-9a98-432b-8160-ad51e7005c58 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.547518 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52813c-9a98-432b-8160-ad51e7005c58 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.548032 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52813c-9a98-432b-8160-ad51e7005c58 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.548873 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52813c-9a98-432b-8160-ad51e7005c58 None admin] RBAC: Adding query filter params (name=member) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:30.549385 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52813c-9a98-432b-8160-ad51e7005c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:30.550915 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52813c-9a98-432b-8160-ad51e7005c58 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:30.564013 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 62/122] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:30.564147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:30.564224 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52813c-9a98-432b-8160-ad51e7005c58 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.629148 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553eef2-38d6-4249-a6a1-d5918215ebd1 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.663782 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d9568-5b59-4486-9116-90b2ce5520cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.664410 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d9568-5b59-4486-9116-90b2ce5520cb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.664697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d9568-5b59-4486-9116-90b2ce5520cb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.664968 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d9568-5b59-4486-9116-90b2ce5520cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.669937 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52813c-9a98-432b-8160-ad51e7005c58 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.675708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d9568-5b59-4486-9116-90b2ce5520cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-ec1d9568-5b59-4486-9116-90b2ce5520cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:30.680531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:30.681455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:30.682338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 61/123] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:30.682960 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d9568-5b59-4486-9116-90b2ce5520cb None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.713840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aae4cb-1548-4c39-8195-204edbeb4da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.714570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aae4cb-1548-4c39-8195-204edbeb4da0 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.714850 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aae4cb-1548-4c39-8195-204edbeb4da0 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.715119 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aae4cb-1548-4c39-8195-204edbeb4da0 None admin] PATH_INFO: `/v3/users/c1b97854cfd447a990a1e65cc1830977` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.716238 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aae4cb-1548-4c39-8195-204edbeb4da0 None admin] RBAC: Authorizing `identity:get_user(user_id=c1b97854cfd447a990a1e65cc1830977)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:30.717910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aae4cb-1548-4c39-8195-204edbeb4da0 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:30.719614 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 63/124] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/users/c1b97854cfd447a990a1e65cc1830977 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:30.720220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aae4cb-1548-4c39-8195-204edbeb4da0 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.786998 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:30.790317 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:30.793823 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d9568-5b59-4486-9116-90b2ce5520cb None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.831518 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55b1ca-46ce-41cc-bc65-35f19547994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.832404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55b1ca-46ce-41cc-bc65-35f19547994e None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.832840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55b1ca-46ce-41cc-bc65-35f19547994e None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.833117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55b1ca-46ce-41cc-bc65-35f19547994e None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283/users/fdf274baf5444ff3b62a655abb478066/roles/1245a77a23c14542b165310facdab5cd` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.835472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55b1ca-46ce-41cc-bc65-35f19547994e None admin] RBAC: Authorizing `identity:create_grant(project_id=db23ab1161614bd8b0da96131a1fd283, user_id=fdf274baf5444ff3b62a655abb478066, role_id=1245a77a23c14542b165310facdab5cd)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:30.836886 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55b1ca-46ce-41cc-bc65-35f19547994e None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:30.844840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aae4cb-1548-4c39-8195-204edbeb4da0 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:30.878631 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903f8f6-174d-4e48-9441-f254e7745c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:30.879249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903f8f6-174d-4e48-9441-f254e7745c71 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:30.879525 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903f8f6-174d-4e48-9441-f254e7745c71 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:30.879795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903f8f6-174d-4e48-9441-f254e7745c71 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:30.881143 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903f8f6-174d-4e48-9441-f254e7745c71 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:30.882681 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903f8f6-174d-4e48-9441-f254e7745c71 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:30.884418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 64/125] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:30.885298 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903f8f6-174d-4e48-9441-f254e7745c71 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:30.898756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 62/126] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:37:30 2022] PUT /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283/users/fdf274baf5444ff3b62a655abb478066/roles/1245a77a23c14542b165310facdab5cd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:37:30.900580 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55b1ca-46ce-41cc-bc65-35f19547994e None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:31.007877 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903f8f6-174d-4e48-9441-f254e7745c71 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:31.043633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:31.059696 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073cc37-0066-4810-8fb2-9438efd273a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:31.061565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073cc37-0066-4810-8fb2-9438efd273a8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:31.061853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073cc37-0066-4810-8fb2-9438efd273a8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:31.062139 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073cc37-0066-4810-8fb2-9438efd273a8 None admin] PATH_INFO: `/v3/users/fdf274baf5444ff3b62a655abb478066` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:31.063432 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073cc37-0066-4810-8fb2-9438efd273a8 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf274baf5444ff3b62a655abb478066)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:31.065392 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073cc37-0066-4810-8fb2-9438efd273a8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:31.066562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55b1ca-46ce-41cc-bc65-35f19547994e None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:31.067491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 65/127] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/users/fdf274baf5444ff3b62a655abb478066 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:31.068148 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073cc37-0066-4810-8fb2-9438efd273a8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:31.108137 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218081a-d7f9-4d18-8e7a-88bae292ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:31.109073 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218081a-d7f9-4d18-8e7a-88bae292ae92 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:31.109603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218081a-d7f9-4d18-8e7a-88bae292ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:31.110076 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218081a-d7f9-4d18-8e7a-88bae292ae92 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:31.110934 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218081a-d7f9-4d18-8e7a-88bae292ae92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:31.111431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218081a-d7f9-4d18-8e7a-88bae292ae92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:31.113037 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218081a-d7f9-4d18-8e7a-88bae292ae92 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:31.123004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 63/128] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:31.124115 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218081a-d7f9-4d18-8e7a-88bae292ae92 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:31.145958 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:31.196237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073cc37-0066-4810-8fb2-9438efd273a8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:31.237623 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453130ec-f0e6-4d17-9c2e-55d7efdb850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:31.238636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453130ec-f0e6-4d17-9c2e-55d7efdb850d None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:31.238993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453130ec-f0e6-4d17-9c2e-55d7efdb850d None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:31.239343 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453130ec-f0e6-4d17-9c2e-55d7efdb850d None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:31.241055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453130ec-f0e6-4d17-9c2e-55d7efdb850d None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:31.242912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453130ec-f0e6-4d17-9c2e-55d7efdb850d None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:31.243713 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218081a-d7f9-4d18-8e7a-88bae292ae92 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:31.244937 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 66/129] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:31 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:31.246048 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453130ec-f0e6-4d17-9c2e-55d7efdb850d None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:31.288380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d8e40-8672-4667-8669-e48f3a14386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:31.289545 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d8e40-8672-4667-8669-e48f3a14386a None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:31.289932 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d8e40-8672-4667-8669-e48f3a14386a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:31.290336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d8e40-8672-4667-8669-e48f3a14386a None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283/users/fdf274baf5444ff3b62a655abb478066/roles/dc25b689a7f8405a807147fca4ae3d0b` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:31.293857 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d8e40-8672-4667-8669-e48f3a14386a None admin] RBAC: Authorizing `identity:create_grant(project_id=db23ab1161614bd8b0da96131a1fd283, user_id=fdf274baf5444ff3b62a655abb478066, role_id=dc25b689a7f8405a807147fca4ae3d0b)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:31.297400 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d8e40-8672-4667-8669-e48f3a14386a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:31.324813 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:31.369464 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453130ec-f0e6-4d17-9c2e-55d7efdb850d None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:31.391574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 64/130] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:37:31 2022] PUT /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283/users/fdf274baf5444ff3b62a655abb478066/roles/dc25b689a7f8405a807147fca4ae3d0b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:37:31.392768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d8e40-8672-4667-8669-e48f3a14386a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:31.430991 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc244af-c70c-45c1-abad-33798fbb23cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:31.432542 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc244af-c70c-45c1-abad-33798fbb23cf None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:31.434131 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc244af-c70c-45c1-abad-33798fbb23cf None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:31.434637 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc244af-c70c-45c1-abad-33798fbb23cf None admin] PATH_INFO: `/v3/projects/ebbe0d505b044dfb991a21b7e6cde5b5` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:31.437815 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc244af-c70c-45c1-abad-33798fbb23cf None admin] RBAC: Authorizing `identity:get_project(project_id=ebbe0d505b044dfb991a21b7e6cde5b5)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:31.441915 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc244af-c70c-45c1-abad-33798fbb23cf None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:31.447626 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 67/131] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:31 2022] GET /identity/v3/projects/ebbe0d505b044dfb991a21b7e6cde5b5 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:31.448730 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc244af-c70c-45c1-abad-33798fbb23cf None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:31.569129 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc244af-c70c-45c1-abad-33798fbb23cf None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:31.570651 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:31.611703 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:31.615887 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d8e40-8672-4667-8669-e48f3a14386a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:31.624299 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c72aa-de85-48eb-a995-13ad2a3eb4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:31.625351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c72aa-de85-48eb-a995-13ad2a3eb4b8 None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:31.625803 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c72aa-de85-48eb-a995-13ad2a3eb4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:31.626268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c72aa-de85-48eb-a995-13ad2a3eb4b8 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283/users/c1b97854cfd447a990a1e65cc1830977/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:31.629368 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c72aa-de85-48eb-a995-13ad2a3eb4b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=db23ab1161614bd8b0da96131a1fd283, user_id=c1b97854cfd447a990a1e65cc1830977, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:31.631849 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c72aa-de85-48eb-a995-13ad2a3eb4b8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:31.659431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d388b5b-7489-4a48-b872-6d8bb20382c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:31.660067 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d388b5b-7489-4a48-b872-6d8bb20382c5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:31.660346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d388b5b-7489-4a48-b872-6d8bb20382c5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:31.660617 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d388b5b-7489-4a48-b872-6d8bb20382c5 None admin] PATH_INFO: `/v3/users/ef505b093fe3473f86b7af937728ef4e` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:31.676250 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d388b5b-7489-4a48-b872-6d8bb20382c5 None admin] RBAC: Authorizing `identity:get_user(user_id=ef505b093fe3473f86b7af937728ef4e)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:31.677758 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d388b5b-7489-4a48-b872-6d8bb20382c5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:31.679708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 65/132] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:31 2022] GET /identity/v3/users/ef505b093fe3473f86b7af937728ef4e => generated 289 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:31.680422 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d388b5b-7489-4a48-b872-6d8bb20382c5 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:31.697396 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 68/133] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:37:31 2022] PUT /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283/users/c1b97854cfd447a990a1e65cc1830977/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:37:31.698912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c72aa-de85-48eb-a995-13ad2a3eb4b8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:31.845545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c72aa-de85-48eb-a995-13ad2a3eb4b8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:31.899532 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d388b5b-7489-4a48-b872-6d8bb20382c5 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:31.947346 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ff96b-1eb9-4796-9bf4-f9b71857c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:31.947964 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff96b-1eb9-4796-9bf4-f9b71857c23f None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:31.948472 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff96b-1eb9-4796-9bf4-f9b71857c23f None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:31.948737 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff96b-1eb9-4796-9bf4-f9b71857c23f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:31.955495 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa560bea-d241-44ff-8f53-890bf7e2cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:31.956709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa560bea-d241-44ff-8f53-890bf7e2cfcc None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:31.957259 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa560bea-d241-44ff-8f53-890bf7e2cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:31.957740 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa560bea-d241-44ff-8f53-890bf7e2cfcc None admin] PATH_INFO: `/v3/projects/ebbe0d505b044dfb991a21b7e6cde5b5/users/fdf274baf5444ff3b62a655abb478066/roles/dc25b689a7f8405a807147fca4ae3d0b` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:31.961079 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa560bea-d241-44ff-8f53-890bf7e2cfcc None admin] RBAC: Authorizing `identity:create_grant(project_id=ebbe0d505b044dfb991a21b7e6cde5b5, user_id=fdf274baf5444ff3b62a655abb478066, role_id=dc25b689a7f8405a807147fca4ae3d0b)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:31.963440 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa560bea-d241-44ff-8f53-890bf7e2cfcc None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:31.969518 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:32.024505 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:32.039225 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ff96b-1eb9-4796-9bf4-f9b71857c23f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:32.041311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ff96b-1eb9-4796-9bf4-f9b71857c23f None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:32.100105 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 66/134] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:37:31 2022] PUT /identity/v3/projects/ebbe0d505b044dfb991a21b7e6cde5b5/users/fdf274baf5444ff3b62a655abb478066/roles/dc25b689a7f8405a807147fca4ae3d0b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:37:32.164128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 69/135] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:32.170150 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa560bea-d241-44ff-8f53-890bf7e2cfcc None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:32.332896 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa560bea-d241-44ff-8f53-890bf7e2cfcc None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:32.376662 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eef392-be33-4a0b-bb58-347f86438bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:32.391337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eef392-be33-4a0b-bb58-347f86438bab None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:32.391337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eef392-be33-4a0b-bb58-347f86438bab None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:32.391337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eef392-be33-4a0b-bb58-347f86438bab None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:32.391337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eef392-be33-4a0b-bb58-347f86438bab None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:32.391337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eef392-be33-4a0b-bb58-347f86438bab None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:32.391337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 67/136] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:32 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:32.392000 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ff96b-1eb9-4796-9bf4-f9b71857c23f None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:32.512711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:32.528910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ff96b-1eb9-4796-9bf4-f9b71857c23f None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:32.572770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1cdf5-ec76-46a9-9a6c-53f682f07ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:32.573422 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1cdf5-ec76-46a9-9a6c-53f682f07ce9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:32.573707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1cdf5-ec76-46a9-9a6c-53f682f07ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:32.573981 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1cdf5-ec76-46a9-9a6c-53f682f07ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:32.574713 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1cdf5-ec76-46a9-9a6c-53f682f07ce9 None admin] RBAC: Adding query filter params (role.id=bf255d5513714f5e9f7841fe571300be, scope.project.id=db23ab1161614bd8b0da96131a1fd283, user.id=ef505b093fe3473f86b7af937728ef4e) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:32.575026 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1cdf5-ec76-46a9-9a6c-53f682f07ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:32.576532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1cdf5-ec76-46a9-9a6c-53f682f07ce9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:32.582713 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 70/137] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:32 2022] GET /identity/v3/role_assignments?user.id=ef505b093fe3473f86b7af937728ef4e&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=bf255d5513714f5e9f7841fe571300be => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:32.716202 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b036-0104-40af-acb8-8cdfd65549b1 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:32.717242 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b036-0104-40af-acb8-8cdfd65549b1 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:32.717741 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b036-0104-40af-acb8-8cdfd65549b1 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:32.719720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 68/138] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:32.725148 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b9d4d-4d38-4193-bcb9-d32207c13ac5 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:32.725457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b9d4d-4d38-4193-bcb9-d32207c13ac5 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:32.725734 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b9d4d-4d38-4193-bcb9-d32207c13ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:32.754647 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-ac8b9d4d-4d38-4193-bcb9-d32207c13ac5 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:32.756275 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-ac8b9d4d-4d38-4193-bcb9-d32207c13ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:32.859565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 71/139] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:33.530251 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b036-0104-40af-acb8-8cdfd65549b1 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:33.618739 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:33.670114 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b036-0104-40af-acb8-8cdfd65549b1 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:33.714420 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e193-62f4-49ab-a42f-3fcd5f704ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:33.715077 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e193-62f4-49ab-a42f-3fcd5f704ac9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:33.715366 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e193-62f4-49ab-a42f-3fcd5f704ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:33.715641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e193-62f4-49ab-a42f-3fcd5f704ac9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:33.721234 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604e193-62f4-49ab-a42f-3fcd5f704ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:33.722723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604e193-62f4-49ab-a42f-3fcd5f704ac9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:33.724400 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 69/140] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:33.730227 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b9d4d-4d38-4193-bcb9-d32207c13ac5 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:33.883409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:33.911379 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b9d4d-4d38-4193-bcb9-d32207c13ac5 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:33.956197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef7758-2e5a-4ee1-823e-e01f77402dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:33.956880 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7758-2e5a-4ee1-823e-e01f77402dab None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:33.957146 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7758-2e5a-4ee1-823e-e01f77402dab None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:33.957446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7758-2e5a-4ee1-823e-e01f77402dab None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:33.958116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef7758-2e5a-4ee1-823e-e01f77402dab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:33.959576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef7758-2e5a-4ee1-823e-e01f77402dab None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:34.074371 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 72/141] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:37:33 2022] POST /identity/v3/users => generated 283 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:34.639714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf9d24-ba78-4842-ad4e-3af3c46646c4 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:34.639904 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf9d24-ba78-4842-ad4e-3af3c46646c4 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:34.640193 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf9d24-ba78-4842-ad4e-3af3c46646c4 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:34.641721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 70/142] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:34.655617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48951b-70cf-4201-b2fa-2cffb4da2e3d None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:34.655617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48951b-70cf-4201-b2fa-2cffb4da2e3d None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:34.655617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48951b-70cf-4201-b2fa-2cffb4da2e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:34.682721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-de48951b-70cf-4201-b2fa-2cffb4da2e3d None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:34.684294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-de48951b-70cf-4201-b2fa-2cffb4da2e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:34.775702 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 73/143] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:35.165644 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bc0a9-985a-4c62-be69-230a50c86443 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:35.166708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bc0a9-985a-4c62-be69-230a50c86443 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:35.166973 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bc0a9-985a-4c62-be69-230a50c86443 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:35.168243 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 71/144] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:35.173831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691824-4fae-419d-80e4-c2715da64229 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:35.174350 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691824-4fae-419d-80e4-c2715da64229 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:35.174828 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691824-4fae-419d-80e4-c2715da64229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:35.194051 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-ae691824-4fae-419d-80e4-c2715da64229 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:35.195392 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-ae691824-4fae-419d-80e4-c2715da64229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:35.196156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047642c1-35ff-44d9-a68b-d31e6d05b2fc None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:35.196456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047642c1-35ff-44d9-a68b-d31e6d05b2fc None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:35.196743 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047642c1-35ff-44d9-a68b-d31e6d05b2fc None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:35.198661 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 72/145] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:35.204318 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ac5b-0ab6-4d66-9aa9-9f585ff8dd91 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:35.204598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ac5b-0ab6-4d66-9aa9-9f585ff8dd91 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:35.204884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ac5b-0ab6-4d66-9aa9-9f585ff8dd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:35.238274 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-6980ac5b-0ab6-4d66-9aa9-9f585ff8dd91 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:35.239502 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-6980ac5b-0ab6-4d66-9aa9-9f585ff8dd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:35.308389 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:35.320123 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 74/146] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:35.342966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 73/147] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:35.425634 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691824-4fae-419d-80e4-c2715da64229 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:35.557210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691824-4fae-419d-80e4-c2715da64229 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:35.600857 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008258f-433b-4a23-aca9-b0ea3ebab8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:35.601521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008258f-433b-4a23-aca9-b0ea3ebab8c2 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:35.601803 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008258f-433b-4a23-aca9-b0ea3ebab8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:35.602075 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008258f-433b-4a23-aca9-b0ea3ebab8c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:35.618972 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008258f-433b-4a23-aca9-b0ea3ebab8c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-3008258f-433b-4a23-aca9-b0ea3ebab8c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:35.624288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:35.625271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:35.626933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 75/148] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:37:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:35.631588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ac5b-0ab6-4d66-9aa9-9f585ff8dd91 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:35.714191 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:35.763958 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ac5b-0ab6-4d66-9aa9-9f585ff8dd91 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:35.804791 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fe3aa-2e39-4b98-95bb-39853eeb01e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:35.808957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fe3aa-2e39-4b98-95bb-39853eeb01e5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:35.808957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fe3aa-2e39-4b98-95bb-39853eeb01e5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:35.808957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fe3aa-2e39-4b98-95bb-39853eeb01e5 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:35.808957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fe3aa-2e39-4b98-95bb-39853eeb01e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:35.808957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fe3aa-2e39-4b98-95bb-39853eeb01e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:35.808957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fe3aa-2e39-4b98-95bb-39853eeb01e5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:35.819548 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 74/149] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:37:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:35.822554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008258f-433b-4a23-aca9-b0ea3ebab8c2 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:35.826469 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fe3aa-2e39-4b98-95bb-39853eeb01e5 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:35.942520 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:36.020693 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fe3aa-2e39-4b98-95bb-39853eeb01e5 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:36.026915 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008258f-433b-4a23-aca9-b0ea3ebab8c2 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:36.067625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:36.088112 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f632013-ec32-44c5-8209-a403b343c080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:36.088747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632013-ec32-44c5-8209-a403b343c080 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.089025 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632013-ec32-44c5-8209-a403b343c080 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.089320 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632013-ec32-44c5-8209-a403b343c080 None admin] PATH_INFO: `/v3/users/fdf274baf5444ff3b62a655abb478066` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.090479 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f632013-ec32-44c5-8209-a403b343c080 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf274baf5444ff3b62a655abb478066)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:36.092014 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f632013-ec32-44c5-8209-a403b343c080 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:36.093823 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 75/150] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:35 2022] GET /identity/v3/users/fdf274baf5444ff3b62a655abb478066 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:36.097539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72cae7-f5a5-4809-93ce-19a16a56ca0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:36.098222 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72cae7-f5a5-4809-93ce-19a16a56ca0a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.098497 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72cae7-f5a5-4809-93ce-19a16a56ca0a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.098769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72cae7-f5a5-4809-93ce-19a16a56ca0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.099544 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f632013-ec32-44c5-8209-a403b343c080 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:36.118632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72cae7-f5a5-4809-93ce-19a16a56ca0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-1f72cae7-f5a5-4809-93ce-19a16a56ca0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:36.124247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:36.125098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:36.125930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:36.129923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 76/151] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:36.138518 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72cae7-f5a5-4809-93ce-19a16a56ca0a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:36.234455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f632013-ec32-44c5-8209-a403b343c080 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:36.274967 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72cae7-f5a5-4809-93ce-19a16a56ca0a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:36.290095 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba719f9-706d-48d9-a9bf-b534c31c7fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:36.290095 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba719f9-706d-48d9-a9bf-b534c31c7fc0 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.290607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba719f9-706d-48d9-a9bf-b534c31c7fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.290762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba719f9-706d-48d9-a9bf-b534c31c7fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.301371 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:36.332170 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2d5e-c602-4546-bb78-29e5599a9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:36.332835 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2d5e-c602-4546-bb78-29e5599a9106 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.333156 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2d5e-c602-4546-bb78-29e5599a9106 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.333447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2d5e-c602-4546-bb78-29e5599a9106 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.334113 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f2d5e-c602-4546-bb78-29e5599a9106 None admin] RBAC: Adding query filter params (name=member) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:36.334411 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f2d5e-c602-4546-bb78-29e5599a9106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:36.335898 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f2d5e-c602-4546-bb78-29e5599a9106 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:36.345639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 77/152] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:36.350468 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a53f23-74dc-4d41-a16d-c8e8a401395e None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.350751 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a53f23-74dc-4d41-a16d-c8e8a401395e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.351019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a53f23-74dc-4d41-a16d-c8e8a401395e None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.352320 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 78/153] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:36.353009 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a53f23-74dc-4d41-a16d-c8e8a401395e None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:36.371379 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:36.382753 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba719f9-706d-48d9-a9bf-b534c31c7fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:36.386701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba719f9-706d-48d9-a9bf-b534c31c7fc0 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:36.464081 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a53f23-74dc-4d41-a16d-c8e8a401395e None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:36.505388 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6abe2-8fa4-4e4d-a431-c6f3afdf18a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:36.506022 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6abe2-8fa4-4e4d-a431-c6f3afdf18a9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.506300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6abe2-8fa4-4e4d-a431-c6f3afdf18a9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.506625 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6abe2-8fa4-4e4d-a431-c6f3afdf18a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.510273 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 76/154] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 20:37:36.515747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f382b-43f7-46a9-99bd-3733194f7d0f None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.515747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f382b-43f7-46a9-99bd-3733194f7d0f None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.515747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f382b-43f7-46a9-99bd-3733194f7d0f None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.515747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 77/155] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:36.515747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6dfb-4577-4ff1-b7d8-5d407687a950 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.515747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6dfb-4577-4ff1-b7d8-5d407687a950 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.516266 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6dfb-4577-4ff1-b7d8-5d407687a950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.528216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6abe2-8fa4-4e4d-a431-c6f3afdf18a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-7fe6abe2-8fa4-4e4d-a431-c6f3afdf18a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:36.534041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:36.534904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:36.535722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:36.537897 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-1ecc6dfb-4577-4ff1-b7d8-5d407687a950 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:36.538066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 79/156] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:37:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:36.538970 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6abe2-8fa4-4e4d-a431-c6f3afdf18a9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:36.539313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-1ecc6dfb-4577-4ff1-b7d8-5d407687a950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:36.617948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:36.625935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 78/157] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:36.632624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6dfb-4577-4ff1-b7d8-5d407687a950 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:36.655544 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:36.745984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6abe2-8fa4-4e4d-a431-c6f3afdf18a9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:36.787021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6dfb-4577-4ff1-b7d8-5d407687a950 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:36.811453 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb104f-8b96-47da-bc51-cba1490cefb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:36.812088 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb104f-8b96-47da-bc51-cba1490cefb1 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.812410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb104f-8b96-47da-bc51-cba1490cefb1 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.812683 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb104f-8b96-47da-bc51-cba1490cefb1 None admin] PATH_INFO: `/v3/users/fdf274baf5444ff3b62a655abb478066` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.814511 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb104f-8b96-47da-bc51-cba1490cefb1 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf274baf5444ff3b62a655abb478066)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:36.815953 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb104f-8b96-47da-bc51-cba1490cefb1 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:36.820469 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 80/158] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:36 2022] GET /identity/v3/users/fdf274baf5444ff3b62a655abb478066 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:36.826800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf08b4c-360c-4035-8f94-f245b2a07fa3 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.827864 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf08b4c-360c-4035-8f94-f245b2a07fa3 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.829572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf08b4c-360c-4035-8f94-f245b2a07fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.865950 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7698151-3d36-453c-b710-d78426bad0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:36.866856 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7698151-3d36-453c-b710-d78426bad0c1 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:36.867340 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7698151-3d36-453c-b710-d78426bad0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:36.867745 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7698151-3d36-453c-b710-d78426bad0c1 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:36.868784 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-dcf08b4c-360c-4035-8f94-f245b2a07fa3 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:36.871323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-dcf08b4c-360c-4035-8f94-f245b2a07fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:36.871533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7698151-3d36-453c-b710-d78426bad0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:36.875052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7698151-3d36-453c-b710-d78426bad0c1 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:36.876826 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 79/159] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:36 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:36.880435 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7698151-3d36-453c-b710-d78426bad0c1 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:36.962628 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 81/160] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:36.963897 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf08b4c-360c-4035-8f94-f245b2a07fa3 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:37.002834 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:37.056376 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:37.071073 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7698151-3d36-453c-b710-d78426bad0c1 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:37.086301 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf08b4c-360c-4035-8f94-f245b2a07fa3 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:37.137206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625cfb5-7b55-4f35-8409-81ddcf4c4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:37.137206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625cfb5-7b55-4f35-8409-81ddcf4c4f6a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:37.137206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625cfb5-7b55-4f35-8409-81ddcf4c4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:37.137206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625cfb5-7b55-4f35-8409-81ddcf4c4f6a None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:37.137608 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625cfb5-7b55-4f35-8409-81ddcf4c4f6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:37.137608 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625cfb5-7b55-4f35-8409-81ddcf4c4f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:37.137937 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625cfb5-7b55-4f35-8409-81ddcf4c4f6a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:37.146529 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 80/161] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:37.147370 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625cfb5-7b55-4f35-8409-81ddcf4c4f6a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:37.161890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e71458-1d22-4f37-8b5d-aec82dbf1e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:37.165221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e71458-1d22-4f37-8b5d-aec82dbf1e2b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:37.165221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e71458-1d22-4f37-8b5d-aec82dbf1e2b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:37.165221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e71458-1d22-4f37-8b5d-aec82dbf1e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:37.335495 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625cfb5-7b55-4f35-8409-81ddcf4c4f6a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:37.373238 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e71458-1d22-4f37-8b5d-aec82dbf1e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:37.374727 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e71458-1d22-4f37-8b5d-aec82dbf1e2b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:37.398837 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9796cd1-a095-4fc2-82fc-5a3b15891a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:37.399456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796cd1-a095-4fc2-82fc-5a3b15891a3b None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:37.399737 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796cd1-a095-4fc2-82fc-5a3b15891a3b None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:37.400009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796cd1-a095-4fc2-82fc-5a3b15891a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:37.401451 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9796cd1-a095-4fc2-82fc-5a3b15891a3b None admin] RBAC: Adding query filter params (role.id=1245a77a23c14542b165310facdab5cd, scope.project.id=db23ab1161614bd8b0da96131a1fd283, user.id=fdf274baf5444ff3b62a655abb478066) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:37.401762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9796cd1-a095-4fc2-82fc-5a3b15891a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:37.403334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9796cd1-a095-4fc2-82fc-5a3b15891a3b None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:37.414219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 81/162] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:37 2022] GET /identity/v3/role_assignments?user.id=fdf274baf5444ff3b62a655abb478066&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=1245a77a23c14542b165310facdab5cd => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:37.415380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9796cd1-a095-4fc2-82fc-5a3b15891a3b None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:37.448658 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:37.455572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:37.563977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 82/163] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:37.564867 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e71458-1d22-4f37-8b5d-aec82dbf1e2b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:37.630701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9796cd1-a095-4fc2-82fc-5a3b15891a3b None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:37.675641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e71458-1d22-4f37-8b5d-aec82dbf1e2b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:37.699840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1c9b1-a632-46a6-92b5-daace417b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:37.700837 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1c9b1-a632-46a6-92b5-daace417b54f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:37.701342 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1c9b1-a632-46a6-92b5-daace417b54f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:37.701909 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1c9b1-a632-46a6-92b5-daace417b54f None admin] PATH_INFO: `/v3/users/c1b97854cfd447a990a1e65cc1830977` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:37.703392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1c9b1-a632-46a6-92b5-daace417b54f None admin] RBAC: Authorizing `identity:get_user(user_id=c1b97854cfd447a990a1e65cc1830977)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:37.705053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1c9b1-a632-46a6-92b5-daace417b54f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:37.707034 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 82/164] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:37 2022] GET /identity/v3/users/c1b97854cfd447a990a1e65cc1830977 => generated 247 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:37.708007 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1c9b1-a632-46a6-92b5-daace417b54f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:37.719382 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a620b-8bbb-461a-97db-b460be4932d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:37.720018 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a620b-8bbb-461a-97db-b460be4932d4 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:37.720288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a620b-8bbb-461a-97db-b460be4932d4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:37.720717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a620b-8bbb-461a-97db-b460be4932d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:37.723641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:37.732321 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a620b-8bbb-461a-97db-b460be4932d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-471a620b-8bbb-461a-97db-b460be4932d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:37.737565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:37.746475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 83/165] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:37.747401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a620b-8bbb-461a-97db-b460be4932d4 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:37.895570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a620b-8bbb-461a-97db-b460be4932d4 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:37.939984 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:37.944093 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e4ae-b4c6-4c7b-8732-30f7d8ccc623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:37.953454 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e4ae-b4c6-4c7b-8732-30f7d8ccc623 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:37.953454 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e4ae-b4c6-4c7b-8732-30f7d8ccc623 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:37.953454 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e4ae-b4c6-4c7b-8732-30f7d8ccc623 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:37.953454 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393e4ae-b4c6-4c7b-8732-30f7d8ccc623 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:37.953454 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393e4ae-b4c6-4c7b-8732-30f7d8ccc623 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:37.953454 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 84/166] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:37 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:37.953857 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e4ae-b4c6-4c7b-8732-30f7d8ccc623 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:37.964476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1c9b1-a632-46a6-92b5-daace417b54f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:38.040007 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069172b-5898-4ff7-bd85-618e67e37208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:38.040663 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069172b-5898-4ff7-bd85-618e67e37208 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:38.041524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069172b-5898-4ff7-bd85-618e67e37208 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:38.041828 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069172b-5898-4ff7-bd85-618e67e37208 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:38.060126 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069172b-5898-4ff7-bd85-618e67e37208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:38.061229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-f069172b-5898-4ff7-bd85-618e67e37208 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:38.073588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:38.080162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 83/167] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:38.081017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069172b-5898-4ff7-bd85-618e67e37208 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:38.109118 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e4ae-b4c6-4c7b-8732-30f7d8ccc623 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:38.166521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa2fc-01c7-4d8b-80d3-cdbb6222dc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:38.167141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa2fc-01c7-4d8b-80d3-cdbb6222dc8f None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:38.167422 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa2fc-01c7-4d8b-80d3-cdbb6222dc8f None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:38.167691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa2fc-01c7-4d8b-80d3-cdbb6222dc8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:38.215875 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069172b-5898-4ff7-bd85-618e67e37208 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:38.272574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a29a-f457-4e4f-91fc-9604a1d8ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:38.273212 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a29a-f457-4e4f-91fc-9604a1d8ef76 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:38.273497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a29a-f457-4e4f-91fc-9604a1d8ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:38.273772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a29a-f457-4e4f-91fc-9604a1d8ef76 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:38.274456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a29a-f457-4e4f-91fc-9604a1d8ef76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:38.274760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a29a-f457-4e4f-91fc-9604a1d8ef76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:38.276632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a29a-f457-4e4f-91fc-9604a1d8ef76 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:38.291729 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 84/168] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:38.293112 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a29a-f457-4e4f-91fc-9604a1d8ef76 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:38.304416 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:38.345260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caa2fc-01c7-4d8b-80d3-cdbb6222dc8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:38.346725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caa2fc-01c7-4d8b-80d3-cdbb6222dc8f None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:38.422606 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a29a-f457-4e4f-91fc-9604a1d8ef76 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:38.464808 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117b4a-39b0-46b4-84c5-b0304e3e0772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:38.465448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117b4a-39b0-46b4-84c5-b0304e3e0772 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:38.465728 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117b4a-39b0-46b4-84c5-b0304e3e0772 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:38.466001 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117b4a-39b0-46b4-84c5-b0304e3e0772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:38.466902 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117b4a-39b0-46b4-84c5-b0304e3e0772 None admin] RBAC: Adding query filter params (role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=db23ab1161614bd8b0da96131a1fd283, user.id=fdf274baf5444ff3b62a655abb478066) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:38.467212 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117b4a-39b0-46b4-84c5-b0304e3e0772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:38.469114 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117b4a-39b0-46b4-84c5-b0304e3e0772 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:38.475948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 85/169] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:38 2022] GET /identity/v3/role_assignments?user.id=fdf274baf5444ff3b62a655abb478066&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:38.478655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117b4a-39b0-46b4-84c5-b0304e3e0772 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:38.513040 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:38.621445 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 85/170] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:38.627743 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa2fc-01c7-4d8b-80d3-cdbb6222dc8f None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:38.641107 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:38.712149 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117b4a-39b0-46b4-84c5-b0304e3e0772 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:38.825733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5ebb0-7a3f-4d6d-a6e5-cd94d243bd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:38.826383 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ebb0-7a3f-4d6d-a6e5-cd94d243bd62 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:38.826660 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ebb0-7a3f-4d6d-a6e5-cd94d243bd62 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:38.826931 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ebb0-7a3f-4d6d-a6e5-cd94d243bd62 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:38.827624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5ebb0-7a3f-4d6d-a6e5-cd94d243bd62 None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:38.827928 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5ebb0-7a3f-4d6d-a6e5-cd94d243bd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:38.829396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5ebb0-7a3f-4d6d-a6e5-cd94d243bd62 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:38.847112 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 86/171] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:38.848071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5ebb0-7a3f-4d6d-a6e5-cd94d243bd62 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:38.878891 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa2fc-01c7-4d8b-80d3-cdbb6222dc8f None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:38.940412 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ee5e-bf28-477b-982b-d67c119445cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:38.941038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ee5e-bf28-477b-982b-d67c119445cb None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:38.941344 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ee5e-bf28-477b-982b-d67c119445cb None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:38.941613 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ee5e-bf28-477b-982b-d67c119445cb None admin] PATH_INFO: `/v3/users/ef505b093fe3473f86b7af937728ef4e` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:38.943689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3ee5e-bf28-477b-982b-d67c119445cb None admin] RBAC: Authorizing `identity:get_user(user_id=ef505b093fe3473f86b7af937728ef4e)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:38.946080 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3ee5e-bf28-477b-982b-d67c119445cb None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:38.946979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 86/172] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:38 2022] GET /identity/v3/users/ef505b093fe3473f86b7af937728ef4e => generated 289 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:38.948026 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ee5e-bf28-477b-982b-d67c119445cb None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:38.997194 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:39.016555 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5ebb0-7a3f-4d6d-a6e5-cd94d243bd62 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:39.049100 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:39.054727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f46aa-ab8e-4644-8e9f-a5b4deb5243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:39.055689 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f46aa-ab8e-4644-8e9f-a5b4deb5243b None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.056169 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f46aa-ab8e-4644-8e9f-a5b4deb5243b None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.056694 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f46aa-ab8e-4644-8e9f-a5b4deb5243b None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.058338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f46aa-ab8e-4644-8e9f-a5b4deb5243b None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:39.060060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f46aa-ab8e-4644-8e9f-a5b4deb5243b None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:39.062212 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 87/173] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:38 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:39.063604 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53d9ed-03fb-4da9-a9c1-97f2a7767fd6 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.070891 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53d9ed-03fb-4da9-a9c1-97f2a7767fd6 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.070891 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53d9ed-03fb-4da9-a9c1-97f2a7767fd6 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.070891 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 88/174] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:39.071735 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53d9ed-03fb-4da9-a9c1-97f2a7767fd6 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:39.086514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ee5e-bf28-477b-982b-d67c119445cb None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:39.138638 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec2581-afb6-4da9-84f4-53a5e21c7aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:39.140100 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec2581-afb6-4da9-84f4-53a5e21c7aaf None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.140812 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec2581-afb6-4da9-84f4-53a5e21c7aaf None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.141323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec2581-afb6-4da9-84f4-53a5e21c7aaf None admin] PATH_INFO: `/v3/users/fdf274baf5444ff3b62a655abb478066` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.142936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec2581-afb6-4da9-84f4-53a5e21c7aaf None admin] RBAC: Authorizing `identity:get_user(user_id=fdf274baf5444ff3b62a655abb478066)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:39.144996 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec2581-afb6-4da9-84f4-53a5e21c7aaf None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:39.147756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 87/175] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:38 2022] GET /identity/v3/users/fdf274baf5444ff3b62a655abb478066 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:39.149057 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec2581-afb6-4da9-84f4-53a5e21c7aaf None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:39.201932 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53d9ed-03fb-4da9-a9c1-97f2a7767fd6 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:39.238120 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d67305-1283-4000-bdd6-75ed632beb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:39.238767 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d67305-1283-4000-bdd6-75ed632beb93 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.239045 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d67305-1283-4000-bdd6-75ed632beb93 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.239316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d67305-1283-4000-bdd6-75ed632beb93 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.240477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d67305-1283-4000-bdd6-75ed632beb93 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:39.241966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d67305-1283-4000-bdd6-75ed632beb93 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:39.243626 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 89/176] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:39 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:39.250263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccd017-7826-4741-8cdc-1b0cf7512dc0 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.250495 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccd017-7826-4741-8cdc-1b0cf7512dc0 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.250748 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccd017-7826-4741-8cdc-1b0cf7512dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.262432 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:39.265915 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec2581-afb6-4da9-84f4-53a5e21c7aaf None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:39.269681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-87ccd017-7826-4741-8cdc-1b0cf7512dc0 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:39.270846 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-87ccd017-7826-4741-8cdc-1b0cf7512dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:39.301882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639000eb-e75b-42b6-8a32-abd1c714e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:39.302491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639000eb-e75b-42b6-8a32-abd1c714e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.302767 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639000eb-e75b-42b6-8a32-abd1c714e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.303038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639000eb-e75b-42b6-8a32-abd1c714e7c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.303755 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639000eb-e75b-42b6-8a32-abd1c714e7c0 None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=db23ab1161614bd8b0da96131a1fd283, user.id=c1b97854cfd447a990a1e65cc1830977) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:39.304161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639000eb-e75b-42b6-8a32-abd1c714e7c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:39.305522 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639000eb-e75b-42b6-8a32-abd1c714e7c0 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:39.317202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 88/177] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:39 2022] GET /identity/v3/role_assignments?user.id=c1b97854cfd447a990a1e65cc1830977&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:39.317202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2b2e5-5563-47ce-8f4a-2e8ed6058db2 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.317202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2b2e5-5563-47ce-8f4a-2e8ed6058db2 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.317202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2b2e5-5563-47ce-8f4a-2e8ed6058db2 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.325200 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 89/178] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:39.325200 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2b2e5-5563-47ce-8f4a-2e8ed6058db2 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:39.360146 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:39.373264 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 90/179] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:39.378111 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccd017-7826-4741-8cdc-1b0cf7512dc0 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:39.502100 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2b2e5-5563-47ce-8f4a-2e8ed6058db2 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:39.563734 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0454ce-1fe1-4581-a42a-fe0fb3bfc5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:39.564394 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0454ce-1fe1-4581-a42a-fe0fb3bfc5dd None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.564855 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0454ce-1fe1-4581-a42a-fe0fb3bfc5dd None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.565128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0454ce-1fe1-4581-a42a-fe0fb3bfc5dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.569817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccd017-7826-4741-8cdc-1b0cf7512dc0 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:39.609064 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:39.612468 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c600ab5-9c06-4aab-afa0-06592db21364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:39.613426 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c600ab5-9c06-4aab-afa0-06592db21364 None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.613896 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c600ab5-9c06-4aab-afa0-06592db21364 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.614356 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c600ab5-9c06-4aab-afa0-06592db21364 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283/users/ef505b093fe3473f86b7af937728ef4e/roles/bf255d5513714f5e9f7841fe571300be` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.616514 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c600ab5-9c06-4aab-afa0-06592db21364 None admin] RBAC: Authorizing `identity:create_grant(project_id=db23ab1161614bd8b0da96131a1fd283, user_id=ef505b093fe3473f86b7af937728ef4e, role_id=bf255d5513714f5e9f7841fe571300be)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:39.618386 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c600ab5-9c06-4aab-afa0-06592db21364 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:39.654036 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0454ce-1fe1-4581-a42a-fe0fb3bfc5dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:39.655837 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0454ce-1fe1-4581-a42a-fe0fb3bfc5dd None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:39.708703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 91/180] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:37:39 2022] PUT /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283/users/ef505b093fe3473f86b7af937728ef4e/roles/bf255d5513714f5e9f7841fe571300be => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:37:39.710455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83598-be2b-4754-a9cd-6a455a21a944 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.710735 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83598-be2b-4754-a9cd-6a455a21a944 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.711012 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83598-be2b-4754-a9cd-6a455a21a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.738718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-bbd83598-be2b-4754-a9cd-6a455a21a944 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:39.740272 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-bbd83598-be2b-4754-a9cd-6a455a21a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:39.796047 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 90/181] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:39.797542 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8897312-a31d-4c1c-88d0-fe8a92bd69cf None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.797832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8897312-a31d-4c1c-88d0-fe8a92bd69cf None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.798158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8897312-a31d-4c1c-88d0-fe8a92bd69cf None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:39.799642 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 91/182] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:39.801963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8897312-a31d-4c1c-88d0-fe8a92bd69cf None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:39.841361 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:39.858077 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 92/183] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:39.858941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd83598-be2b-4754-a9cd-6a455a21a944 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:39.895958 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:39.950106 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8897312-a31d-4c1c-88d0-fe8a92bd69cf None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:39.974224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd83598-be2b-4754-a9cd-6a455a21a944 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:39.997275 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec344f-f96a-4739-938d-aee97029f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:39.998434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec344f-f96a-4739-938d-aee97029f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:39.999199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec344f-f96a-4739-938d-aee97029f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:39.999632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec344f-f96a-4739-938d-aee97029f7b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.012415 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec344f-f96a-4739-938d-aee97029f7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-a9ec344f-f96a-4739-938d-aee97029f7b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:40.018585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:40.019460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:40.020532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 92/184] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:37:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:40.021362 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd607-c442-4981-851a-6d0bf198022c None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.021362 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd607-c442-4981-851a-6d0bf198022c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.021492 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd607-c442-4981-851a-6d0bf198022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.024935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ead53-58f8-489e-b67a-731e07f07539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:40.026491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ead53-58f8-489e-b67a-731e07f07539 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.026949 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ead53-58f8-489e-b67a-731e07f07539 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.027393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ead53-58f8-489e-b67a-731e07f07539 None admin] PATH_INFO: `/v3/projects/ebbe0d505b044dfb991a21b7e6cde5b5` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.028783 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ead53-58f8-489e-b67a-731e07f07539 None admin] RBAC: Authorizing `identity:get_project(project_id=ebbe0d505b044dfb991a21b7e6cde5b5)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:40.030525 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ead53-58f8-489e-b67a-731e07f07539 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:40.032321 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 93/185] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:39 2022] GET /identity/v3/projects/ebbe0d505b044dfb991a21b7e6cde5b5 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:40.032987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ead53-58f8-489e-b67a-731e07f07539 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:40.043610 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-b0bcd607-c442-4981-851a-6d0bf198022c None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:40.045507 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-b0bcd607-c442-4981-851a-6d0bf198022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:40.109708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:40.130820 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 93/186] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:40.131936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd607-c442-4981-851a-6d0bf198022c None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:40.165641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ead53-58f8-489e-b67a-731e07f07539 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:40.216626 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d73e-4ca7-4248-aea7-984e03dbb5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:40.217564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d73e-4ca7-4248-aea7-984e03dbb5c8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.218049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d73e-4ca7-4248-aea7-984e03dbb5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.218490 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d73e-4ca7-4248-aea7-984e03dbb5c8 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.219337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d73e-4ca7-4248-aea7-984e03dbb5c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:40.219903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d73e-4ca7-4248-aea7-984e03dbb5c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:40.221467 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d73e-4ca7-4248-aea7-984e03dbb5c8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:40.225008 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:40.231177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 94/187] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:40.232233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d73e-4ca7-4248-aea7-984e03dbb5c8 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:40.280306 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd607-c442-4981-851a-6d0bf198022c None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:40.331079 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41123634-92f2-4123-a928-01989b7f6511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:40.332366 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41123634-92f2-4123-a928-01989b7f6511 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.332876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41123634-92f2-4123-a928-01989b7f6511 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.333392 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41123634-92f2-4123-a928-01989b7f6511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.334408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41123634-92f2-4123-a928-01989b7f6511 None admin] RBAC: Adding query filter params (role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=ebbe0d505b044dfb991a21b7e6cde5b5, user.id=fdf274baf5444ff3b62a655abb478066) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:40.334943 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41123634-92f2-4123-a928-01989b7f6511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:40.336580 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41123634-92f2-4123-a928-01989b7f6511 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:40.344246 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 94/188] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:40 2022] GET /identity/v3/role_assignments?user.id=fdf274baf5444ff3b62a655abb478066&scope.project.id=ebbe0d505b044dfb991a21b7e6cde5b5&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:40.345469 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41123634-92f2-4123-a928-01989b7f6511 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:40.350182 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d73e-4ca7-4248-aea7-984e03dbb5c8 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:40.371801 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:40.391887 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe07b8-4691-47de-b51f-c81a3e928420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:40.392944 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe07b8-4691-47de-b51f-c81a3e928420 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.393487 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe07b8-4691-47de-b51f-c81a3e928420 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.393969 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe07b8-4691-47de-b51f-c81a3e928420 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.419846 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe07b8-4691-47de-b51f-c81a3e928420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-3ebe07b8-4691-47de-b51f-c81a3e928420 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:40.432562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:40.433549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:40.434347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:40.442174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 95/189] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:37:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:40.452634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe07b8-4691-47de-b51f-c81a3e928420 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:40.548205 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41123634-92f2-4123-a928-01989b7f6511 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:40.573598 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:40.585762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe07b8-4691-47de-b51f-c81a3e928420 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:40.599337 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc907d2-d6fa-4fdc-aa8e-bfd6296a0988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:40.600366 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc907d2-d6fa-4fdc-aa8e-bfd6296a0988 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.600740 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc907d2-d6fa-4fdc-aa8e-bfd6296a0988 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.600914 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc907d2-d6fa-4fdc-aa8e-bfd6296a0988 None admin] PATH_INFO: `/v3/users/2bab5a12e25e4815abc118606fe91e42` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.621791 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc907d2-d6fa-4fdc-aa8e-bfd6296a0988 None admin] RBAC: Authorizing `identity:get_user(user_id=2bab5a12e25e4815abc118606fe91e42)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:40.623436 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc907d2-d6fa-4fdc-aa8e-bfd6296a0988 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:40.625300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 95/190] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:40 2022] GET /identity/v3/users/2bab5a12e25e4815abc118606fe91e42 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:40.625938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc907d2-d6fa-4fdc-aa8e-bfd6296a0988 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:40.627779 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b98f0-512b-4b22-b26f-4e9c77afbeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:40.628493 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b98f0-512b-4b22-b26f-4e9c77afbeca None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.628780 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b98f0-512b-4b22-b26f-4e9c77afbeca None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.629051 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b98f0-512b-4b22-b26f-4e9c77afbeca None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.629894 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b98f0-512b-4b22-b26f-4e9c77afbeca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:40.630254 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b98f0-512b-4b22-b26f-4e9c77afbeca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:40.631900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b98f0-512b-4b22-b26f-4e9c77afbeca None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:40.641259 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 96/191] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:37:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:40.641939 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b98f0-512b-4b22-b26f-4e9c77afbeca None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:40.707480 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:40.746274 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc907d2-d6fa-4fdc-aa8e-bfd6296a0988 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:40.769048 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b98f0-512b-4b22-b26f-4e9c77afbeca None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:40.782311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae5d12-0618-42a3-8fc4-d40b36ebf103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:40.782937 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5d12-0618-42a3-8fc4-d40b36ebf103 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.783216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5d12-0618-42a3-8fc4-d40b36ebf103 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.783489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5d12-0618-42a3-8fc4-d40b36ebf103 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.784589 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae5d12-0618-42a3-8fc4-d40b36ebf103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:40.786047 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae5d12-0618-42a3-8fc4-d40b36ebf103 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:40.787609 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 96/192] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:40.788460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae5d12-0618-42a3-8fc4-d40b36ebf103 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:40.812739 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131968fa-a1f1-4421-8772-15fbc7f2e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:40.813372 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131968fa-a1f1-4421-8772-15fbc7f2e922 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.814113 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131968fa-a1f1-4421-8772-15fbc7f2e922 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.814113 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131968fa-a1f1-4421-8772-15fbc7f2e922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.844865 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:40.887322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131968fa-a1f1-4421-8772-15fbc7f2e922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:40.888725 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131968fa-a1f1-4421-8772-15fbc7f2e922 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:40.902022 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae5d12-0618-42a3-8fc4-d40b36ebf103 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:40.930930 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:40.942495 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f04b9-9bdf-4307-9d06-5b7be881bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:40.943388 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f04b9-9bdf-4307-9d06-5b7be881bddf None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:40.943693 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f04b9-9bdf-4307-9d06-5b7be881bddf None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:40.943955 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f04b9-9bdf-4307-9d06-5b7be881bddf None admin] PATH_INFO: `/v3/users/2bab5a12e25e4815abc118606fe91e42` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:40.945117 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f04b9-9bdf-4307-9d06-5b7be881bddf None admin] RBAC: Authorizing `identity:get_user(user_id=2bab5a12e25e4815abc118606fe91e42)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:40.946660 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f04b9-9bdf-4307-9d06-5b7be881bddf None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:40.948460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 97/193] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:40 2022] GET /identity/v3/users/2bab5a12e25e4815abc118606fe91e42 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:40.949364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f04b9-9bdf-4307-9d06-5b7be881bddf None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:40.996360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 97/194] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:40.997608 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131968fa-a1f1-4421-8772-15fbc7f2e922 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:41.074020 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f04b9-9bdf-4307-9d06-5b7be881bddf None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:41.089770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:41.111902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493ad3d-1694-4d5f-b9b3-377ba9e61d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:41.112780 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493ad3d-1694-4d5f-b9b3-377ba9e61d58 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:41.113242 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493ad3d-1694-4d5f-b9b3-377ba9e61d58 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:41.113519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493ad3d-1694-4d5f-b9b3-377ba9e61d58 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:41.114235 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493ad3d-1694-4d5f-b9b3-377ba9e61d58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:41.115687 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493ad3d-1694-4d5f-b9b3-377ba9e61d58 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:41.117763 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131968fa-a1f1-4421-8772-15fbc7f2e922 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:41.154720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e4878-5ad3-444d-847f-b60c4369496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:41.155428 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e4878-5ad3-444d-847f-b60c4369496a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:41.155704 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e4878-5ad3-444d-847f-b60c4369496a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:41.155971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e4878-5ad3-444d-847f-b60c4369496a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:41.167533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:41.202576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 98/195] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:37:40 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:41.203504 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493ad3d-1694-4d5f-b9b3-377ba9e61d58 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:41.242032 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e4878-5ad3-444d-847f-b60c4369496a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:41.243689 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e4878-5ad3-444d-847f-b60c4369496a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:41.339466 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493ad3d-1694-4d5f-b9b3-377ba9e61d58 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:41.377883 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1623c9-09e5-47b6-9ed9-6b494b3dff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:41.378124 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 98/196] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:41.378603 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1623c9-09e5-47b6-9ed9-6b494b3dff75 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:41.378948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1623c9-09e5-47b6-9ed9-6b494b3dff75 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:41.379272 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1623c9-09e5-47b6-9ed9-6b494b3dff75 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:41.380423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1623c9-09e5-47b6-9ed9-6b494b3dff75 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:41.385207 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1623c9-09e5-47b6-9ed9-6b494b3dff75 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:41.385375 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e4878-5ad3-444d-847f-b60c4369496a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:41.390215 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 99/197] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:41 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:41.390215 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1623c9-09e5-47b6-9ed9-6b494b3dff75 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:41.442186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:41.444627 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:41.523004 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1623c9-09e5-47b6-9ed9-6b494b3dff75 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:41.523409 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e4878-5ad3-444d-847f-b60c4369496a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:41.565938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd75a-f945-4727-8105-1cdf27364e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:41.566142 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd75a-f945-4727-8105-1cdf27364e88 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:41.566353 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd75a-f945-4727-8105-1cdf27364e88 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:41.568510 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd75a-f945-4727-8105-1cdf27364e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:41.568510 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dd75a-f945-4727-8105-1cdf27364e88 None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad, user.id=2bab5a12e25e4815abc118606fe91e42) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:41.568510 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dd75a-f945-4727-8105-1cdf27364e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:41.569418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dd75a-f945-4727-8105-1cdf27364e88 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:41.572193 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a8d37-3786-479d-9d79-ef440c6e8542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:41.572815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a8d37-3786-479d-9d79-ef440c6e8542 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:41.573094 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a8d37-3786-479d-9d79-ef440c6e8542 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:41.573414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a8d37-3786-479d-9d79-ef440c6e8542 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:41.574629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a8d37-3786-479d-9d79-ef440c6e8542 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:41.575790 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 100/198] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:41 2022] GET /identity/v3/role_assignments?user.id=2bab5a12e25e4815abc118606fe91e42&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:41.576203 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a8d37-3786-479d-9d79-ef440c6e8542 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:41.578259 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 99/199] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:41 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:41.584683 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd75a-f945-4727-8105-1cdf27364e88 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:41.707913 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:41.710733 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd75a-f945-4727-8105-1cdf27364e88 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:41.750113 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb88ba8-471b-4f85-aaef-6d6eb68383ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:41.750729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb88ba8-471b-4f85-aaef-6d6eb68383ef None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:41.751017 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb88ba8-471b-4f85-aaef-6d6eb68383ef None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:41.751294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb88ba8-471b-4f85-aaef-6d6eb68383ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:41.752031 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb88ba8-471b-4f85-aaef-6d6eb68383ef None admin] RBAC: Adding query filter params (role.id=1245a77a23c14542b165310facdab5cd, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad, user.id=2bab5a12e25e4815abc118606fe91e42) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:41.752344 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb88ba8-471b-4f85-aaef-6d6eb68383ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:41.753889 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb88ba8-471b-4f85-aaef-6d6eb68383ef None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:41.761313 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 101/200] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:41 2022] GET /identity/v3/role_assignments?user.id=2bab5a12e25e4815abc118606fe91e42&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=1245a77a23c14542b165310facdab5cd => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:42.485336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44bda-4996-4025-914a-c9936770acd3 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:42.486228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44bda-4996-4025-914a-c9936770acd3 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:42.486638 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44bda-4996-4025-914a-c9936770acd3 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:42.488105 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 100/201] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:42.493405 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41694162-3bc1-439b-9426-2f231879ed09 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:42.494150 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41694162-3bc1-439b-9426-2f231879ed09 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:42.494655 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41694162-3bc1-439b-9426-2f231879ed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:42.515954 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-41694162-3bc1-439b-9426-2f231879ed09 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:42.517372 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-41694162-3bc1-439b-9426-2f231879ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:42.607785 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 102/202] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:43.155873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb44bda-4996-4025-914a-c9936770acd3 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:43.286135 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb44bda-4996-4025-914a-c9936770acd3 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:43.299936 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:43.342983 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c6ace-20fb-4760-9ac0-31098432d68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:43.344033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c6ace-20fb-4760-9ac0-31098432d68f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:43.344522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c6ace-20fb-4760-9ac0-31098432d68f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:43.345003 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c6ace-20fb-4760-9ac0-31098432d68f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:43.361195 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c6ace-20fb-4760-9ac0-31098432d68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-c65c6ace-20fb-4760-9ac0-31098432d68f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:43.366313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:43.367181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:43.367979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:43.370705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 101/203] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:43.376664 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41694162-3bc1-439b-9426-2f231879ed09 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:43.503091 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:43.516132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41694162-3bc1-439b-9426-2f231879ed09 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:43.557437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e8fc3-b3ee-43d8-91ec-b5435f0c75e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:43.558057 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e8fc3-b3ee-43d8-91ec-b5435f0c75e5 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:43.558337 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e8fc3-b3ee-43d8-91ec-b5435f0c75e5 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:43.558611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e8fc3-b3ee-43d8-91ec-b5435f0c75e5 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:43.559282 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e8fc3-b3ee-43d8-91ec-b5435f0c75e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:43.559586 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e8fc3-b3ee-43d8-91ec-b5435f0c75e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:43.561021 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e8fc3-b3ee-43d8-91ec-b5435f0c75e5 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:43.569804 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 103/204] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:43.575801 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c6ace-20fb-4760-9ac0-31098432d68f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:43.731020 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c6ace-20fb-4760-9ac0-31098432d68f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:43.792978 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619a35-dc9c-40b1-8b75-8215a9435b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:43.793565 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619a35-dc9c-40b1-8b75-8215a9435b34 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:43.793848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619a35-dc9c-40b1-8b75-8215a9435b34 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:43.794122 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619a35-dc9c-40b1-8b75-8215a9435b34 None admin] PATH_INFO: `/v3/users/ef505b093fe3473f86b7af937728ef4e` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:43.796422 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5619a35-dc9c-40b1-8b75-8215a9435b34 None admin] RBAC: Authorizing `identity:get_user(user_id=ef505b093fe3473f86b7af937728ef4e)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:43.797963 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5619a35-dc9c-40b1-8b75-8215a9435b34 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:43.799604 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 102/205] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:43 2022] GET /identity/v3/users/ef505b093fe3473f86b7af937728ef4e => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:43.805770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e8fc3-b3ee-43d8-91ec-b5435f0c75e5 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:43.957668 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e8fc3-b3ee-43d8-91ec-b5435f0c75e5 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:44.016545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37873a0d-77a7-48b0-8f9b-8548e7485837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:44.017188 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37873a0d-77a7-48b0-8f9b-8548e7485837 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.017478 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37873a0d-77a7-48b0-8f9b-8548e7485837 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.017756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37873a0d-77a7-48b0-8f9b-8548e7485837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.057670 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:44.112382 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37873a0d-77a7-48b0-8f9b-8548e7485837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:44.113885 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37873a0d-77a7-48b0-8f9b-8548e7485837 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:44.265354 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 104/206] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:44.268782 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619a35-dc9c-40b1-8b75-8215a9435b34 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:44.341952 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:44.434026 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2ed2f-6b8e-42fd-b9d0-3fc32dd545d0 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.434348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2ed2f-6b8e-42fd-b9d0-3fc32dd545d0 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.434579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2ed2f-6b8e-42fd-b9d0-3fc32dd545d0 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.436055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 105/207] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:44.441505 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1b8b-e622-411b-b4e5-807174f21930 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.442299 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1b8b-e622-411b-b4e5-807174f21930 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.442677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1b8b-e622-411b-b4e5-807174f21930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.451335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619a35-dc9c-40b1-8b75-8215a9435b34 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:44.474263 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-36bf1b8b-e622-411b-b4e5-807174f21930 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:44.475492 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-36bf1b8b-e622-411b-b4e5-807174f21930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:44.494526 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b42e8-b2b3-4317-b00e-6c9cc0b358de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:44.495340 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b42e8-b2b3-4317-b00e-6c9cc0b358de None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.495616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b42e8-b2b3-4317-b00e-6c9cc0b358de None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.495884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b42e8-b2b3-4317-b00e-6c9cc0b358de None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.498402 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b42e8-b2b3-4317-b00e-6c9cc0b358de None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:44.499863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b42e8-b2b3-4317-b00e-6c9cc0b358de None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:44.505878 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 103/208] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:44 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:44.511518 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b42e8-b2b3-4317-b00e-6c9cc0b358de None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:44.569399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:44.613860 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 106/209] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:44.657364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3acbc-bfc6-4ec0-87f8-558c2641bc4c None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.657669 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3acbc-bfc6-4ec0-87f8-558c2641bc4c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.657922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3acbc-bfc6-4ec0-87f8-558c2641bc4c None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.659389 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 107/210] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:44.664697 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21a6c5-91fb-4985-8efe-3d348c0ef8f0 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.664978 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21a6c5-91fb-4985-8efe-3d348c0ef8f0 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.667003 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b42e8-b2b3-4317-b00e-6c9cc0b358de None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:44.669338 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21a6c5-91fb-4985-8efe-3d348c0ef8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.673462 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:44.697223 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-3b21a6c5-91fb-4985-8efe-3d348c0ef8f0 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:44.698785 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-3b21a6c5-91fb-4985-8efe-3d348c0ef8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:44.724816 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f6b53-9ba0-4a9b-9f8b-364d36436d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:44.726032 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f6b53-9ba0-4a9b-9f8b-364d36436d52 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.726597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f6b53-9ba0-4a9b-9f8b-364d36436d52 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.727142 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f6b53-9ba0-4a9b-9f8b-364d36436d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.728225 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f6b53-9ba0-4a9b-9f8b-364d36436d52 None admin] RBAC: Adding query filter params (role.id=bf255d5513714f5e9f7841fe571300be, scope.project.id=db23ab1161614bd8b0da96131a1fd283, user.id=ef505b093fe3473f86b7af937728ef4e) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:44.729818 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f6b53-9ba0-4a9b-9f8b-364d36436d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:44.731868 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f6b53-9ba0-4a9b-9f8b-364d36436d52 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:44.739522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 104/211] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:44 2022] GET /identity/v3/role_assignments?user.id=ef505b093fe3473f86b7af937728ef4e&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=bf255d5513714f5e9f7841fe571300be => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:44.741117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ca9a-9d11-4153-9420-9fbe8901d7c3 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.741615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ca9a-9d11-4153-9420-9fbe8901d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.742060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ca9a-9d11-4153-9420-9fbe8901d7c3 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.743518 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 105/212] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:44.750777 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db5c2-6b30-4b35-b857-9534372d0a6b None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.751839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db5c2-6b30-4b35-b857-9534372d0a6b None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.752330 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db5c2-6b30-4b35-b857-9534372d0a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.778319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-fb8db5c2-6b30-4b35-b857-9534372d0a6b None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:44.779849 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-fb8db5c2-6b30-4b35-b857-9534372d0a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:44.780543 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 108/213] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:44.863539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d38dd-ddd7-4716-9ea9-c8b343e002f0 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.863954 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d38dd-ddd7-4716-9ea9-c8b343e002f0 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.864171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d38dd-ddd7-4716-9ea9-c8b343e002f0 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.865664 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 109/214] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:37:44.872959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46058941-ed21-422e-8552-8f662fffbc6c None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:44.873398 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46058941-ed21-422e-8552-8f662fffbc6c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:44.873738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46058941-ed21-422e-8552-8f662fffbc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:44.907306 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-46058941-ed21-422e-8552-8f662fffbc6c None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:44.908832 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 106/215] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:44.910330 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-46058941-ed21-422e-8552-8f662fffbc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:45.008698 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 110/216] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:45.066521 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8db5c2-6b30-4b35-b857-9534372d0a6b None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.154254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46058941-ed21-422e-8552-8f662fffbc6c None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.167726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:45.172105 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8db5c2-6b30-4b35-b857-9534372d0a6b None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.211290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2ab4d-c136-4a6f-97bd-96b492416181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.212370 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2ab4d-c136-4a6f-97bd-96b492416181 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.213408 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2ab4d-c136-4a6f-97bd-96b492416181 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.213945 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2ab4d-c136-4a6f-97bd-96b492416181 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.215984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:45.226798 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2ab4d-c136-4a6f-97bd-96b492416181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-84f2ab4d-c136-4a6f-97bd-96b492416181 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:45.232362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:45.233453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:45.234443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:45.237705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 107/217] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:45.245599 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2ab4d-c136-4a6f-97bd-96b492416181 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.304983 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46058941-ed21-422e-8552-8f662fffbc6c None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.352839 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0fb04-1e01-412b-b99f-3044450ddf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.353817 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0fb04-1e01-412b-b99f-3044450ddf41 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.354097 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0fb04-1e01-412b-b99f-3044450ddf41 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.354367 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0fb04-1e01-412b-b99f-3044450ddf41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.369491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0fb04-1e01-412b-b99f-3044450ddf41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:45.371225 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2ab4d-c136-4a6f-97bd-96b492416181 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-c3f0fb04-1e01-412b-b99f-3044450ddf41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:45.374294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:45.375144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:45.375921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 111/218] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:37:45.376563 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0fb04-1e01-412b-b99f-3044450ddf41 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.413900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f262e6-0909-4a5e-bb0d-092fbceb5ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.414425 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f262e6-0909-4a5e-bb0d-092fbceb5ccc None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.414703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f262e6-0909-4a5e-bb0d-092fbceb5ccc None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.414977 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f262e6-0909-4a5e-bb0d-092fbceb5ccc None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.415694 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f262e6-0909-4a5e-bb0d-092fbceb5ccc None admin] RBAC: Adding query filter params (name=admin) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:45.416091 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f262e6-0909-4a5e-bb0d-092fbceb5ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:45.417542 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f262e6-0909-4a5e-bb0d-092fbceb5ccc None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:45.425902 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 108/219] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:45.426568 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f262e6-0909-4a5e-bb0d-092fbceb5ccc None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.449449 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:45.485279 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0fb04-1e01-412b-b99f-3044450ddf41 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.492506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:45.518754 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4715166-a4ea-48e6-9ebe-da9b134390db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.519377 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4715166-a4ea-48e6-9ebe-da9b134390db None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.519655 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4715166-a4ea-48e6-9ebe-da9b134390db None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.519933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4715166-a4ea-48e6-9ebe-da9b134390db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.525394 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f262e6-0909-4a5e-bb0d-092fbceb5ccc None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.530848 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4715166-a4ea-48e6-9ebe-da9b134390db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-f4715166-a4ea-48e6-9ebe-da9b134390db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:45.535706 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:45.536564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:45.537399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 112/220] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:45.538048 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4715166-a4ea-48e6-9ebe-da9b134390db None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.564052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fcab1-345a-47f4-a8fa-fca8fba66332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.564648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fcab1-345a-47f4-a8fa-fca8fba66332 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.564922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fcab1-345a-47f4-a8fa-fca8fba66332 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.565266 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fcab1-345a-47f4-a8fa-fca8fba66332 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.565923 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fcab1-345a-47f4-a8fa-fca8fba66332 None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:45.566218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fcab1-345a-47f4-a8fa-fca8fba66332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:45.567579 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fcab1-345a-47f4-a8fa-fca8fba66332 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:45.575691 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 109/221] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:45.576467 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fcab1-345a-47f4-a8fa-fca8fba66332 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.638115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4715166-a4ea-48e6-9ebe-da9b134390db None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.657661 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:45.671611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56755d-ffa5-4cd7-b101-c6d320f61e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.672168 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56755d-ffa5-4cd7-b101-c6d320f61e18 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.672465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56755d-ffa5-4cd7-b101-c6d320f61e18 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.672734 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56755d-ffa5-4cd7-b101-c6d320f61e18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.674047 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56755d-ffa5-4cd7-b101-c6d320f61e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:45.675520 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56755d-ffa5-4cd7-b101-c6d320f61e18 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:45.676754 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fcab1-345a-47f4-a8fa-fca8fba66332 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.677247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 113/222] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:45.677875 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56755d-ffa5-4cd7-b101-c6d320f61e18 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.714259 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:45.714549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc7334-1369-441a-b780-c95492b1a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.715181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc7334-1369-441a-b780-c95492b1a178 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.715467 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc7334-1369-441a-b780-c95492b1a178 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.715736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc7334-1369-441a-b780-c95492b1a178 None admin] PATH_INFO: `/v3/users/2bab5a12e25e4815abc118606fe91e42` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.716876 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc7334-1369-441a-b780-c95492b1a178 None admin] RBAC: Authorizing `identity:get_user(user_id=2bab5a12e25e4815abc118606fe91e42)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:45.718360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc7334-1369-441a-b780-c95492b1a178 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:45.719926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 110/223] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/users/2bab5a12e25e4815abc118606fe91e42 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:45.720685 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc7334-1369-441a-b780-c95492b1a178 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.784972 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56755d-ffa5-4cd7-b101-c6d320f61e18 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.820216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b2b7-4356-41ee-836a-8a8b0d70ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.820847 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b2b7-4356-41ee-836a-8a8b0d70ff5e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.821130 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b2b7-4356-41ee-836a-8a8b0d70ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.821441 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b2b7-4356-41ee-836a-8a8b0d70ff5e None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.822160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2b2b7-4356-41ee-836a-8a8b0d70ff5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:45.822483 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2b2b7-4356-41ee-836a-8a8b0d70ff5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:45.823861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2b2b7-4356-41ee-836a-8a8b0d70ff5e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:45.824702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc7334-1369-441a-b780-c95492b1a178 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.831722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 114/224] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:45.832508 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b2b7-4356-41ee-836a-8a8b0d70ff5e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.859596 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfafae-e7a7-4133-9bcf-d11ad1c36fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.860223 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfafae-e7a7-4133-9bcf-d11ad1c36fce None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.860503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfafae-e7a7-4133-9bcf-d11ad1c36fce None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.860779 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfafae-e7a7-4133-9bcf-d11ad1c36fce None admin] PATH_INFO: `/v3/users/56992252992b43ac9ae86174cebc9146` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.874555 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfafae-e7a7-4133-9bcf-d11ad1c36fce None admin] RBAC: Authorizing `identity:get_user(user_id=56992252992b43ac9ae86174cebc9146)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:45.876019 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfafae-e7a7-4133-9bcf-d11ad1c36fce None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:45.877662 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 111/225] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/users/56992252992b43ac9ae86174cebc9146 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:45.878418 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfafae-e7a7-4133-9bcf-d11ad1c36fce None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:45.892035 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:45.929368 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:45.934861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b2b7-4356-41ee-836a-8a8b0d70ff5e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:45.967740 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd144940-da82-4888-a8aa-c2edfcd3a9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:45.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd144940-da82-4888-a8aa-c2edfcd3a9a6 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:45.968661 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd144940-da82-4888-a8aa-c2edfcd3a9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:45.968934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd144940-da82-4888-a8aa-c2edfcd3a9a6 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:45.969630 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd144940-da82-4888-a8aa-c2edfcd3a9a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:45.971046 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd144940-da82-4888-a8aa-c2edfcd3a9a6 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:45.983459 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfafae-e7a7-4133-9bcf-d11ad1c36fce None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:46.016083 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543e7c0-766d-4db4-b7b0-3c7cd9ac5290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:46.016699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543e7c0-766d-4db4-b7b0-3c7cd9ac5290 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:46.016974 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543e7c0-766d-4db4-b7b0-3c7cd9ac5290 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:46.017344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543e7c0-766d-4db4-b7b0-3c7cd9ac5290 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:46.018521 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543e7c0-766d-4db4-b7b0-3c7cd9ac5290 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:46.020036 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543e7c0-766d-4db4-b7b0-3c7cd9ac5290 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:46.021670 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 112/226] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:45 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:46.022421 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543e7c0-766d-4db4-b7b0-3c7cd9ac5290 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:46.101202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 115/227] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:37:45 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:46.101202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd144940-da82-4888-a8aa-c2edfcd3a9a6 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:46.107645 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:46.141732 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543e7c0-766d-4db4-b7b0-3c7cd9ac5290 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:46.181127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93f162-0112-45ce-b5b5-48e79b731027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:46.181745 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93f162-0112-45ce-b5b5-48e79b731027 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:46.182005 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93f162-0112-45ce-b5b5-48e79b731027 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:46.182274 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93f162-0112-45ce-b5b5-48e79b731027 None admin] PATH_INFO: `/v3/users/2bab5a12e25e4815abc118606fe91e42` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:46.183458 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93f162-0112-45ce-b5b5-48e79b731027 None admin] RBAC: Authorizing `identity:get_user(user_id=2bab5a12e25e4815abc118606fe91e42)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:46.184911 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93f162-0112-45ce-b5b5-48e79b731027 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:46.186593 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 113/228] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:46 2022] GET /identity/v3/users/2bab5a12e25e4815abc118606fe91e42 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:46.187349 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93f162-0112-45ce-b5b5-48e79b731027 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:46.214609 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd144940-da82-4888-a8aa-c2edfcd3a9a6 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:46.253300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a8c74-62d2-41a8-86eb-b2f401f36308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:46.254002 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a8c74-62d2-41a8-86eb-b2f401f36308 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:46.254282 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a8c74-62d2-41a8-86eb-b2f401f36308 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:46.254557 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a8c74-62d2-41a8-86eb-b2f401f36308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:46.280978 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:46.302650 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93f162-0112-45ce-b5b5-48e79b731027 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:46.334115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a8c74-62d2-41a8-86eb-b2f401f36308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:46.335580 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a8c74-62d2-41a8-86eb-b2f401f36308 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:46.351071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe57b1-c0cb-4b41-82bd-01f7381ea9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:46.351860 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe57b1-c0cb-4b41-82bd-01f7381ea9e4 None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:46.352156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe57b1-c0cb-4b41-82bd-01f7381ea9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:46.353659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe57b1-c0cb-4b41-82bd-01f7381ea9e4 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/users/2bab5a12e25e4815abc118606fe91e42/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:46.356158 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe57b1-c0cb-4b41-82bd-01f7381ea9e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=72850c3bcfc74a83ab924bd3fd1748ad, user_id=2bab5a12e25e4815abc118606fe91e42, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:46.358346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe57b1-c0cb-4b41-82bd-01f7381ea9e4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:46.451749 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 114/229] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:37:46 2022] PUT /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/users/2bab5a12e25e4815abc118606fe91e42/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:37:46.452941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe57b1-c0cb-4b41-82bd-01f7381ea9e4 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:46.459609 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:46.475326 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 116/230] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:46.481614 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a8c74-62d2-41a8-86eb-b2f401f36308 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:46.560430 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:46.606080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe57b1-c0cb-4b41-82bd-01f7381ea9e4 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:46.624983 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a8c74-62d2-41a8-86eb-b2f401f36308 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:46.654776 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980c7b3-c53f-482b-b688-597d464e281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:46.655710 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980c7b3-c53f-482b-b688-597d464e281c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:46.655989 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980c7b3-c53f-482b-b688-597d464e281c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:46.656775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980c7b3-c53f-482b-b688-597d464e281c None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:46.658511 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980c7b3-c53f-482b-b688-597d464e281c None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:46.661097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980c7b3-c53f-482b-b688-597d464e281c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:46.663347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 115/231] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:46 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:46.664846 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3b90-78b7-41a9-8d39-7e7846d21323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:46.665574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3b90-78b7-41a9-8d39-7e7846d21323 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:46.666035 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3b90-78b7-41a9-8d39-7e7846d21323 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:46.666388 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3b90-78b7-41a9-8d39-7e7846d21323 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:46.667554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e3b90-78b7-41a9-8d39-7e7846d21323 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:46.669112 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980c7b3-c53f-482b-b688-597d464e281c None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:46.669319 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e3b90-78b7-41a9-8d39-7e7846d21323 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:46.671058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 117/232] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:46 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:46.698308 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3b90-78b7-41a9-8d39-7e7846d21323 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:46.755182 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:46.793473 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980c7b3-c53f-482b-b688-597d464e281c None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:46.840237 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294621ad-7d80-492b-beb6-e77d7e26829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:46.841316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294621ad-7d80-492b-beb6-e77d7e26829e None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:46.841943 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294621ad-7d80-492b-beb6-e77d7e26829e None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:46.842409 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294621ad-7d80-492b-beb6-e77d7e26829e None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/users/2bab5a12e25e4815abc118606fe91e42/roles/1245a77a23c14542b165310facdab5cd` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:46.844952 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294621ad-7d80-492b-beb6-e77d7e26829e None admin] RBAC: Authorizing `identity:create_grant(project_id=72850c3bcfc74a83ab924bd3fd1748ad, user_id=2bab5a12e25e4815abc118606fe91e42, role_id=1245a77a23c14542b165310facdab5cd)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:46.846728 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294621ad-7d80-492b-beb6-e77d7e26829e None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:46.867795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3b90-78b7-41a9-8d39-7e7846d21323 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:46.892975 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:46.909594 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0840f-23f7-4f1c-9eea-bf06a80f1344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:46.910809 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0840f-23f7-4f1c-9eea-bf06a80f1344 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:46.911476 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0840f-23f7-4f1c-9eea-bf06a80f1344 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:46.912154 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0840f-23f7-4f1c-9eea-bf06a80f1344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:46.913444 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0840f-23f7-4f1c-9eea-bf06a80f1344 None admin] RBAC: Adding query filter params (role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad, user.id=56992252992b43ac9ae86174cebc9146) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:46.913894 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0840f-23f7-4f1c-9eea-bf06a80f1344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:46.915544 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0840f-23f7-4f1c-9eea-bf06a80f1344 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:46.922399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 118/233] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:46 2022] GET /identity/v3/role_assignments?user.id=56992252992b43ac9ae86174cebc9146&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:46.973750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 116/234] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:37:46 2022] PUT /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/users/2bab5a12e25e4815abc118606fe91e42/roles/1245a77a23c14542b165310facdab5cd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 20:37:49.377855 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e034b3-2872-40a6-abed-7a9e996ad675 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:49.378885 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e034b3-2872-40a6-abed-7a9e996ad675 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:49.379384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e034b3-2872-40a6-abed-7a9e996ad675 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:49.381186 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 119/235] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:49.388879 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaf1c2-8267-47b0-8c91-6cbe2190ec15 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:49.390150 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaf1c2-8267-47b0-8c91-6cbe2190ec15 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:49.390583 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaf1c2-8267-47b0-8c91-6cbe2190ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:49.415102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d4aaf1c2-8267-47b0-8c91-6cbe2190ec15 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:49.416469 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d4aaf1c2-8267-47b0-8c91-6cbe2190ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:49.498815 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0542b-b2f5-4dfb-8ba1-c61f0517e267 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:49.498815 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0542b-b2f5-4dfb-8ba1-c61f0517e267 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:49.498815 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0542b-b2f5-4dfb-8ba1-c61f0517e267 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:49.499539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 120/236] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:49.504990 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861ed6-597e-4620-8f38-da0884f69bc7 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:49.505766 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861ed6-597e-4620-8f38-da0884f69bc7 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:49.506261 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861ed6-597e-4620-8f38-da0884f69bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:49.558078 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-b2861ed6-597e-4620-8f38-da0884f69bc7 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:49.559681 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-b2861ed6-597e-4620-8f38-da0884f69bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:49.637036 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 117/237] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:49.638327 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 121/238] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:49.638603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9bd9d-eff5-4c98-b3c0-43a508f0ed95 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:49.639012 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9bd9d-eff5-4c98-b3c0-43a508f0ed95 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:49.639447 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9bd9d-eff5-4c98-b3c0-43a508f0ed95 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:49.641074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 118/239] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:49.658353 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6502cb4-6c7a-4f98-a1a7-a5ceff43203e None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:49.658851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6502cb4-6c7a-4f98-a1a7-a5ceff43203e None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:49.659259 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6502cb4-6c7a-4f98-a1a7-a5ceff43203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:49.683415 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d6502cb4-6c7a-4f98-a1a7-a5ceff43203e None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:49.684844 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d6502cb4-6c7a-4f98-a1a7-a5ceff43203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:49.757698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:49.775498 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 119/240] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:49.955012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d94988-7c44-459d-ab32-5d1cf3f2e64f None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:49.955335 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d94988-7c44-459d-ab32-5d1cf3f2e64f None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:49.955561 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d94988-7c44-459d-ab32-5d1cf3f2e64f None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:49.957118 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 122/241] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:49.963012 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33d935-c2be-44ed-8ad1-b2a52c84d5ad None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:49.963525 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33d935-c2be-44ed-8ad1-b2a52c84d5ad None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:49.963866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33d935-c2be-44ed-8ad1-b2a52c84d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:49.994289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-fa33d935-c2be-44ed-8ad1-b2a52c84d5ad None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:49.995497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-fa33d935-c2be-44ed-8ad1-b2a52c84d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:50.074625 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d94988-7c44-459d-ab32-5d1cf3f2e64f None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.084061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 120/242] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:50.094957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44568-ffd0-4dcb-bd5a-deeb9db6f663 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.095479 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44568-ffd0-4dcb-bd5a-deeb9db6f663 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.095896 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44568-ffd0-4dcb-bd5a-deeb9db6f663 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.097399 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 121/243] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:37:50.102294 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9bfe3-2b62-44e4-a8e7-dff15481db97 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.102734 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9bfe3-2b62-44e4-a8e7-dff15481db97 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.103348 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9bfe3-2b62-44e4-a8e7-dff15481db97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.130727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-65f9bfe3-2b62-44e4-a8e7-dff15481db97 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:50.131928 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-65f9bfe3-2b62-44e4-a8e7-dff15481db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:50.202380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 122/244] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:50.203339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9bfe3-2b62-44e4-a8e7-dff15481db97 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.211757 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d94988-7c44-459d-ab32-5d1cf3f2e64f None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:50.227513 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:50.247892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971f76a-dc7e-4802-bb69-c64f7d6d098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:50.248752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971f76a-dc7e-4802-bb69-c64f7d6d098e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.249285 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971f76a-dc7e-4802-bb69-c64f7d6d098e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.249716 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971f76a-dc7e-4802-bb69-c64f7d6d098e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.260936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971f76a-dc7e-4802-bb69-c64f7d6d098e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-a971f76a-dc7e-4802-bb69-c64f7d6d098e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:50.266023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:50.267104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:50.267985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:50.273916 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 123/245] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:37:50.275888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971f76a-dc7e-4802-bb69-c64f7d6d098e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.277737 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:50.340576 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9bfe3-2b62-44e4-a8e7-dff15481db97 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:50.379205 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d313f11-8be6-4b21-a4f6-80dd7ff3985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:50.379841 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d313f11-8be6-4b21-a4f6-80dd7ff3985d None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.380170 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d313f11-8be6-4b21-a4f6-80dd7ff3985d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.380446 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d313f11-8be6-4b21-a4f6-80dd7ff3985d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.381961 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971f76a-dc7e-4802-bb69-c64f7d6d098e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:50.392487 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d313f11-8be6-4b21-a4f6-80dd7ff3985d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-7d313f11-8be6-4b21-a4f6-80dd7ff3985d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:50.397773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:50.398646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:50.399432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 123/246] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:50.401499 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d313f11-8be6-4b21-a4f6-80dd7ff3985d None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.419447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7be80-70e3-4b07-9d84-a46be32c0ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:50.420077 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7be80-70e3-4b07-9d84-a46be32c0ad1 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.420348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7be80-70e3-4b07-9d84-a46be32c0ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.420680 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7be80-70e3-4b07-9d84-a46be32c0ad1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.421827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7be80-70e3-4b07-9d84-a46be32c0ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:50.423288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7be80-70e3-4b07-9d84-a46be32c0ad1 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:50.424861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 124/247] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:50.425672 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7be80-70e3-4b07-9d84-a46be32c0ad1 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.481448 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:50.514531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d313f11-8be6-4b21-a4f6-80dd7ff3985d None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:50.528957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:50.542990 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7be80-70e3-4b07-9d84-a46be32c0ad1 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:50.551489 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf75243-5da8-4080-9602-e48f5569b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:50.552098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf75243-5da8-4080-9602-e48f5569b67f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.552379 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf75243-5da8-4080-9602-e48f5569b67f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.552856 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf75243-5da8-4080-9602-e48f5569b67f None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.553350 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf75243-5da8-4080-9602-e48f5569b67f None admin] RBAC: Adding query filter params (name=reader) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:50.553654 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf75243-5da8-4080-9602-e48f5569b67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:50.555028 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf75243-5da8-4080-9602-e48f5569b67f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:50.568389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 124/248] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:50.568389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf75243-5da8-4080-9602-e48f5569b67f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.583914 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6fedb-cd7d-42cc-be5f-f7c997ce3c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:50.584522 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6fedb-cd7d-42cc-be5f-f7c997ce3c01 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.584796 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6fedb-cd7d-42cc-be5f-f7c997ce3c01 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.585064 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6fedb-cd7d-42cc-be5f-f7c997ce3c01 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.585763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6fedb-cd7d-42cc-be5f-f7c997ce3c01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:50.586062 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6fedb-cd7d-42cc-be5f-f7c997ce3c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:50.587992 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6fedb-cd7d-42cc-be5f-f7c997ce3c01 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:50.596273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 125/249] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:50.598376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6fedb-cd7d-42cc-be5f-f7c997ce3c01 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.666414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf75243-5da8-4080-9602-e48f5569b67f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:50.696514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6fedb-cd7d-42cc-be5f-f7c997ce3c01 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:50.698846 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:50.699635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf058fd9-8a83-4875-b0c5-06c025402b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:50.699989 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf058fd9-8a83-4875-b0c5-06c025402b24 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.700267 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf058fd9-8a83-4875-b0c5-06c025402b24 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.700534 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf058fd9-8a83-4875-b0c5-06c025402b24 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.701183 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf058fd9-8a83-4875-b0c5-06c025402b24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:50.702635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf058fd9-8a83-4875-b0c5-06c025402b24 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:50.730608 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e7dca-1d62-4edd-9b55-15395a452c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:50.731230 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e7dca-1d62-4edd-9b55-15395a452c4c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.731561 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e7dca-1d62-4edd-9b55-15395a452c4c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.731781 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e7dca-1d62-4edd-9b55-15395a452c4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.742078 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e7dca-1d62-4edd-9b55-15395a452c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-d57e7dca-1d62-4edd-9b55-15395a452c4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:50.747984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:50.748882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 126/250] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:50.749949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e7dca-1d62-4edd-9b55-15395a452c4c None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.792435 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 125/251] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:37:50 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:50.793301 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf058fd9-8a83-4875-b0c5-06c025402b24 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.844064 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:50.869490 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e7dca-1d62-4edd-9b55-15395a452c4c None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:50.909753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf30af-9498-4b64-b954-bbec0a9434f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:50.910445 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf30af-9498-4b64-b954-bbec0a9434f8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.910657 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf30af-9498-4b64-b954-bbec0a9434f8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.910930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf30af-9498-4b64-b954-bbec0a9434f8 None admin] PATH_INFO: `/v3/users/64f2114a0ea34d91b34a3e93298bc86b` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.925898 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf30af-9498-4b64-b954-bbec0a9434f8 None admin] RBAC: Authorizing `identity:get_user(user_id=64f2114a0ea34d91b34a3e93298bc86b)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:50.927380 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf30af-9498-4b64-b954-bbec0a9434f8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:50.928330 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf058fd9-8a83-4875-b0c5-06c025402b24 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:50.934890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 127/252] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:50 2022] GET /identity/v3/users/64f2114a0ea34d91b34a3e93298bc86b => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:50.934890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf30af-9498-4b64-b954-bbec0a9434f8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:50.961211 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:50.983572 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082659f-7cca-4332-8122-5c4169ae8b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:50.984141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082659f-7cca-4332-8122-5c4169ae8b82 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:50.984415 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082659f-7cca-4332-8122-5c4169ae8b82 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:50.984680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082659f-7cca-4332-8122-5c4169ae8b82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:50.996011 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082659f-7cca-4332-8122-5c4169ae8b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-7082659f-7cca-4332-8122-5c4169ae8b82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:51.000853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:51.005581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 126/253] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:37:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:51.006358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082659f-7cca-4332-8122-5c4169ae8b82 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:51.050582 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf30af-9498-4b64-b954-bbec0a9434f8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:51.099508 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89993e-54c6-4915-8b6b-42262a39b348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:51.100958 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89993e-54c6-4915-8b6b-42262a39b348 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:51.101087 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89993e-54c6-4915-8b6b-42262a39b348 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:51.101323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89993e-54c6-4915-8b6b-42262a39b348 None admin] PATH_INFO: `/v3/users/2bab5a12e25e4815abc118606fe91e42` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:51.102476 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89993e-54c6-4915-8b6b-42262a39b348 None admin] RBAC: Authorizing `identity:get_user(user_id=2bab5a12e25e4815abc118606fe91e42)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:51.105229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89993e-54c6-4915-8b6b-42262a39b348 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:51.108366 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 128/254] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:50 2022] GET /identity/v3/users/2bab5a12e25e4815abc118606fe91e42 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:51.108366 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89993e-54c6-4915-8b6b-42262a39b348 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:51.131306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:51.143973 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082659f-7cca-4332-8122-5c4169ae8b82 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:51.190068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b4c48-2a78-45a0-a3ed-f5c680a80d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:51.190685 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b4c48-2a78-45a0-a3ed-f5c680a80d1e None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:51.190976 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b4c48-2a78-45a0-a3ed-f5c680a80d1e None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:51.191241 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b4c48-2a78-45a0-a3ed-f5c680a80d1e None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:51.191908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b4c48-2a78-45a0-a3ed-f5c680a80d1e None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:51.193280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b4c48-2a78-45a0-a3ed-f5c680a80d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:51.193895 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b4c48-2a78-45a0-a3ed-f5c680a80d1e None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:51.203311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 127/255] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:51.204235 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b4c48-2a78-45a0-a3ed-f5c680a80d1e None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:51.226344 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:51.240674 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89993e-54c6-4915-8b6b-42262a39b348 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:51.277879 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9bfac-0126-4dbb-94a3-9bc5f411250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:51.278784 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9bfac-0126-4dbb-94a3-9bc5f411250c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:51.279384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9bfac-0126-4dbb-94a3-9bc5f411250c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:51.279835 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9bfac-0126-4dbb-94a3-9bc5f411250c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:51.334527 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b4c48-2a78-45a0-a3ed-f5c680a80d1e None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:51.358225 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9bfac-0126-4dbb-94a3-9bc5f411250c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:51.359897 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9bfac-0126-4dbb-94a3-9bc5f411250c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:51.374016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da633e-05a8-4918-a88e-238cd06cc394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:51.374928 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da633e-05a8-4918-a88e-238cd06cc394 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:51.375205 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da633e-05a8-4918-a88e-238cd06cc394 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:51.375518 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da633e-05a8-4918-a88e-238cd06cc394 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:51.376344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da633e-05a8-4918-a88e-238cd06cc394 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:51.377010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da633e-05a8-4918-a88e-238cd06cc394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:51.378689 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da633e-05a8-4918-a88e-238cd06cc394 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:51.389406 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 128/256] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:37:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:51.390410 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da633e-05a8-4918-a88e-238cd06cc394 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:51.411145 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:51.477356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:51.500590 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 129/257] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:51.501483 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9bfac-0126-4dbb-94a3-9bc5f411250c None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:51.519830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da633e-05a8-4918-a88e-238cd06cc394 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:51.563992 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff0f22-4340-44a1-bad9-4efde72a385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:51.565774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0f22-4340-44a1-bad9-4efde72a385a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:51.566538 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0f22-4340-44a1-bad9-4efde72a385a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:51.566961 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0f22-4340-44a1-bad9-4efde72a385a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:51.632238 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9bfac-0126-4dbb-94a3-9bc5f411250c None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:51.651866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0f22-4340-44a1-bad9-4efde72a385a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:51.653422 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0f22-4340-44a1-bad9-4efde72a385a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:51.669742 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:51.671360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1839c99-84e3-49d9-94e2-1b35b3d97455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:51.672252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1839c99-84e3-49d9-94e2-1b35b3d97455 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:51.672731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1839c99-84e3-49d9-94e2-1b35b3d97455 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:51.673228 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1839c99-84e3-49d9-94e2-1b35b3d97455 None admin] PATH_INFO: `/v3/users/56992252992b43ac9ae86174cebc9146` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:51.674722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1839c99-84e3-49d9-94e2-1b35b3d97455 None admin] RBAC: Authorizing `identity:get_user(user_id=56992252992b43ac9ae86174cebc9146)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:51.676559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1839c99-84e3-49d9-94e2-1b35b3d97455 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:51.678395 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 130/258] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:51 2022] GET /identity/v3/users/56992252992b43ac9ae86174cebc9146 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:51.679321 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1839c99-84e3-49d9-94e2-1b35b3d97455 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:51.745918 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:51.769282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 129/259] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:51.769282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff0f22-4340-44a1-bad9-4efde72a385a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:51.798342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1839c99-84e3-49d9-94e2-1b35b3d97455 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:51.838940 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decccced-1bf3-492a-9635-23875233b12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:51.839977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decccced-1bf3-492a-9635-23875233b12d None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:51.840565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decccced-1bf3-492a-9635-23875233b12d None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:51.841038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decccced-1bf3-492a-9635-23875233b12d None admin] PATH_INFO: `/v3/users/2bab5a12e25e4815abc118606fe91e42` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:51.842435 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decccced-1bf3-492a-9635-23875233b12d None admin] RBAC: Authorizing `identity:get_user(user_id=2bab5a12e25e4815abc118606fe91e42)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:51.844116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decccced-1bf3-492a-9635-23875233b12d None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:51.850885 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 131/260] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:51 2022] GET /identity/v3/users/2bab5a12e25e4815abc118606fe91e42 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:51.852150 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decccced-1bf3-492a-9635-23875233b12d None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:51.872045 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff0f22-4340-44a1-bad9-4efde72a385a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:51.887339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:51.908870 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479e1e2-5aad-4824-8616-4ac57d18e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:51.909403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479e1e2-5aad-4824-8616-4ac57d18e4d4 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:51.909675 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479e1e2-5aad-4824-8616-4ac57d18e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:51.909941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479e1e2-5aad-4824-8616-4ac57d18e4d4 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:51.911072 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479e1e2-5aad-4824-8616-4ac57d18e4d4 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:51.912503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479e1e2-5aad-4824-8616-4ac57d18e4d4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:51.914612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 130/261] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:51 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:51.915985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479e1e2-5aad-4824-8616-4ac57d18e4d4 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:51.978950 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decccced-1bf3-492a-9635-23875233b12d None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:52.012268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:52.023971 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2922dc-9448-4d62-b890-5656781f32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:52.024544 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2922dc-9448-4d62-b890-5656781f32e2 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:52.025451 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2922dc-9448-4d62-b890-5656781f32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:52.025728 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2922dc-9448-4d62-b890-5656781f32e2 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:52.027312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2922dc-9448-4d62-b890-5656781f32e2 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:52.029432 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2922dc-9448-4d62-b890-5656781f32e2 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:52.031739 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 132/262] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:51 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:52.032326 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2922dc-9448-4d62-b890-5656781f32e2 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:52.047439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479e1e2-5aad-4824-8616-4ac57d18e4d4 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:52.093292 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de270f-e9e8-4d26-9384-a97bedcae747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:52.093939 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de270f-e9e8-4d26-9384-a97bedcae747 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:52.094214 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de270f-e9e8-4d26-9384-a97bedcae747 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:52.094481 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de270f-e9e8-4d26-9384-a97bedcae747 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:52.095977 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de270f-e9e8-4d26-9384-a97bedcae747 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:52.098325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de270f-e9e8-4d26-9384-a97bedcae747 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:52.104937 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 131/263] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:51 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:52.104937 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de270f-e9e8-4d26-9384-a97bedcae747 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:52.158304 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2922dc-9448-4d62-b890-5656781f32e2 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:52.164481 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:52.200116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63181d-6fbe-47c5-9dc0-a1f143cfe5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:52.201098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63181d-6fbe-47c5-9dc0-a1f143cfe5ed None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:52.201635 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63181d-6fbe-47c5-9dc0-a1f143cfe5ed None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:52.202122 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63181d-6fbe-47c5-9dc0-a1f143cfe5ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:52.229510 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de270f-e9e8-4d26-9384-a97bedcae747 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:52.269752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbba4d-489b-4aba-b065-8da43b661a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:52.270733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbba4d-489b-4aba-b065-8da43b661a45 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:52.271016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbba4d-489b-4aba-b065-8da43b661a45 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:52.271286 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbba4d-489b-4aba-b065-8da43b661a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:52.272010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbba4d-489b-4aba-b065-8da43b661a45 None admin] RBAC: Adding query filter params (role.id=bf255d5513714f5e9f7841fe571300be, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad, user.id=64f2114a0ea34d91b34a3e93298bc86b) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:52.272316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbba4d-489b-4aba-b065-8da43b661a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:52.273805 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbba4d-489b-4aba-b065-8da43b661a45 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:52.281798 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 132/264] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:52 2022] GET /identity/v3/role_assignments?user.id=64f2114a0ea34d91b34a3e93298bc86b&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=bf255d5513714f5e9f7841fe571300be => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:52.282991 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbba4d-489b-4aba-b065-8da43b661a45 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:52.285399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:52.311568 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63181d-6fbe-47c5-9dc0-a1f143cfe5ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:52.313400 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63181d-6fbe-47c5-9dc0-a1f143cfe5ed None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:52.421303 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbba4d-489b-4aba-b065-8da43b661a45 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:52.440608 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:52.467216 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b5300-dc37-47d4-8537-7f0613acd86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:52.468127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b5300-dc37-47d4-8537-7f0613acd86d None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:52.468611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b5300-dc37-47d4-8537-7f0613acd86d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:52.469110 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b5300-dc37-47d4-8537-7f0613acd86d None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/users/56992252992b43ac9ae86174cebc9146/roles/dc25b689a7f8405a807147fca4ae3d0b` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:52.472285 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b5300-dc37-47d4-8537-7f0613acd86d None admin] RBAC: Authorizing `identity:create_grant(project_id=72850c3bcfc74a83ab924bd3fd1748ad, user_id=56992252992b43ac9ae86174cebc9146, role_id=dc25b689a7f8405a807147fca4ae3d0b)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:52.473994 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b5300-dc37-47d4-8537-7f0613acd86d None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:52.519940 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 133/265] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:52.521553 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63181d-6fbe-47c5-9dc0-a1f143cfe5ed None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:52.556469 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 133/266] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:37:52 2022] PUT /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/users/56992252992b43ac9ae86174cebc9146/roles/dc25b689a7f8405a807147fca4ae3d0b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:37:52.557709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b5300-dc37-47d4-8537-7f0613acd86d None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:52.710121 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:52.725540 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63181d-6fbe-47c5-9dc0-a1f143cfe5ed None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:52.770270 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b5300-dc37-47d4-8537-7f0613acd86d None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:52.793220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a78c2-ba71-4590-a955-4330ccd94685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:52.793841 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a78c2-ba71-4590-a955-4330ccd94685 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:52.794118 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a78c2-ba71-4590-a955-4330ccd94685 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:52.794386 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a78c2-ba71-4590-a955-4330ccd94685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:52.795138 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a78c2-ba71-4590-a955-4330ccd94685 None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad, user.id=2bab5a12e25e4815abc118606fe91e42) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:52.795423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a78c2-ba71-4590-a955-4330ccd94685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:52.797005 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a78c2-ba71-4590-a955-4330ccd94685 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:52.810930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 134/267] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:52 2022] GET /identity/v3/role_assignments?user.id=2bab5a12e25e4815abc118606fe91e42&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:52.857369 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a9d37-0d17-4881-b9d3-1db2e60f2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:52.858430 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9d37-0d17-4881-b9d3-1db2e60f2dad None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:52.858910 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9d37-0d17-4881-b9d3-1db2e60f2dad None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:52.859377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9d37-0d17-4881-b9d3-1db2e60f2dad None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:52.866066 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a9d37-0d17-4881-b9d3-1db2e60f2dad None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:52.867912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a9d37-0d17-4881-b9d3-1db2e60f2dad None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:52.870901 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 134/268] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:52 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:52.876802 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a78c2-ba71-4590-a955-4330ccd94685 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:53.014237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a78c2-ba71-4590-a955-4330ccd94685 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:53.055169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a66618-7c24-4418-90d1-b989f0945b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:53.055788 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a66618-7c24-4418-90d1-b989f0945b45 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:53.056103 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a66618-7c24-4418-90d1-b989f0945b45 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:53.056376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a66618-7c24-4418-90d1-b989f0945b45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:53.057114 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a66618-7c24-4418-90d1-b989f0945b45 None admin] RBAC: Adding query filter params (role.id=1245a77a23c14542b165310facdab5cd, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad, user.id=2bab5a12e25e4815abc118606fe91e42) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:53.057474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a66618-7c24-4418-90d1-b989f0945b45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:53.059008 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a66618-7c24-4418-90d1-b989f0945b45 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:53.065889 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 135/269] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:52 2022] GET /identity/v3/role_assignments?user.id=2bab5a12e25e4815abc118606fe91e42&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=1245a77a23c14542b165310facdab5cd => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:53.667828 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a215-b851-417a-9210-4003d606b8cd None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:53.668335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a215-b851-417a-9210-4003d606b8cd None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:53.668412 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a215-b851-417a-9210-4003d606b8cd None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:53.670008 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 135/270] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:53.675511 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4349447-39cc-4e30-85bb-d4d62857a0ec None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:53.676312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4349447-39cc-4e30-85bb-d4d62857a0ec None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:53.676805 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4349447-39cc-4e30-85bb-d4d62857a0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:53.698068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-f4349447-39cc-4e30-85bb-d4d62857a0ec None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:53.699596 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-f4349447-39cc-4e30-85bb-d4d62857a0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:53.719573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:53.788611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 136/271] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:53.969759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adea11-eaf1-43ee-b99f-1c1b67b63dd8 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:53.970002 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adea11-eaf1-43ee-b99f-1c1b67b63dd8 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:53.970243 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adea11-eaf1-43ee-b99f-1c1b67b63dd8 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:53.971839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 136/272] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:53.977129 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c3793-d321-425f-a3dd-0d680462c41a None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:53.977443 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c3793-d321-425f-a3dd-0d680462c41a None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:53.978278 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c3793-d321-425f-a3dd-0d680462c41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:53.997351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-be3c3793-d321-425f-a3dd-0d680462c41a None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:53.998541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-be3c3793-d321-425f-a3dd-0d680462c41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:54.068984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 137/273] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:54.128971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adea11-eaf1-43ee-b99f-1c1b67b63dd8 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:54.177118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:54.240818 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adea11-eaf1-43ee-b99f-1c1b67b63dd8 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:54.275748 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf9c45-7ca1-473c-a2bf-dbda35b270a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:54.276383 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf9c45-7ca1-473c-a2bf-dbda35b270a6 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:54.276664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf9c45-7ca1-473c-a2bf-dbda35b270a6 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:54.276936 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf9c45-7ca1-473c-a2bf-dbda35b270a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:54.287472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf9c45-7ca1-473c-a2bf-dbda35b270a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-54bf9c45-7ca1-473c-a2bf-dbda35b270a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:54.293873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:54.294953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:54.296226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 137/274] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:54.301132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c3793-d321-425f-a3dd-0d680462c41a None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:54.400624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:54.423762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c3793-d321-425f-a3dd-0d680462c41a None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:54.432722 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf9c45-7ca1-473c-a2bf-dbda35b270a6 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:54.467337 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2299289-104d-446f-b06d-4956173bcf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:54.467945 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2299289-104d-446f-b06d-4956173bcf75 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:54.468263 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2299289-104d-446f-b06d-4956173bcf75 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:54.468534 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2299289-104d-446f-b06d-4956173bcf75 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:54.469258 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2299289-104d-446f-b06d-4956173bcf75 None admin] RBAC: Adding query filter params (name=member) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:54.469560 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2299289-104d-446f-b06d-4956173bcf75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:54.470953 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2299289-104d-446f-b06d-4956173bcf75 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:54.480677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 138/275] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:54.488338 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2299289-104d-446f-b06d-4956173bcf75 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:54.599595 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf9c45-7ca1-473c-a2bf-dbda35b270a6 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:54.601977 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:54.614698 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2299289-104d-446f-b06d-4956173bcf75 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:54.647133 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f330ab7-3e64-411e-a2eb-a619e0d51ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:54.647924 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f330ab7-3e64-411e-a2eb-a619e0d51ffa None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:54.648304 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f330ab7-3e64-411e-a2eb-a619e0d51ffa None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:54.648673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f330ab7-3e64-411e-a2eb-a619e0d51ffa None admin] PATH_INFO: `/v3/domains/default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:54.650712 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f330ab7-3e64-411e-a2eb-a619e0d51ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:54.652301 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f330ab7-3e64-411e-a2eb-a619e0d51ffa None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:54.659649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 138/276] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:54.662837 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f330ab7-3e64-411e-a2eb-a619e0d51ffa None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:54.671435 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0891-6851-4864-b3d4-d48b5ad8f4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:54.671435 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0891-6851-4864-b3d4-d48b5ad8f4aa None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:54.671435 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0891-6851-4864-b3d4-d48b5ad8f4aa None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:54.672013 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0891-6851-4864-b3d4-d48b5ad8f4aa None admin] PATH_INFO: `/v3/users/aa7a2fa0bb6b4907950091efcf341ae9` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:54.688531 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0891-6851-4864-b3d4-d48b5ad8f4aa None admin] RBAC: Authorizing `identity:get_user(user_id=aa7a2fa0bb6b4907950091efcf341ae9)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:54.690247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0891-6851-4864-b3d4-d48b5ad8f4aa None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:54.697198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 139/277] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:54 2022] GET /identity/v3/users/aa7a2fa0bb6b4907950091efcf341ae9 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:54.699376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0891-6851-4864-b3d4-d48b5ad8f4aa None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:54.702987 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:54.807185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f330ab7-3e64-411e-a2eb-a619e0d51ffa None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:54.844445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbefc1-634e-4cb1-8717-48a4d9fe189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:54.845052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbefc1-634e-4cb1-8717-48a4d9fe189c None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:54.845360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbefc1-634e-4cb1-8717-48a4d9fe189c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:54.845631 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbefc1-634e-4cb1-8717-48a4d9fe189c None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:54.846404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbefc1-634e-4cb1-8717-48a4d9fe189c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:54.847838 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbefc1-634e-4cb1-8717-48a4d9fe189c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:54.850107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0891-6851-4864-b3d4-d48b5ad8f4aa None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:54.889739 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f2e6d-b17b-4435-bc79-0eb712a1c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:54.890440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f2e6d-b17b-4435-bc79-0eb712a1c76b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:54.890778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f2e6d-b17b-4435-bc79-0eb712a1c76b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:54.891113 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f2e6d-b17b-4435-bc79-0eb712a1c76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:54.891896 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f2e6d-b17b-4435-bc79-0eb712a1c76b None admin] RBAC: Adding query filter params (role.id=dc25b689a7f8405a807147fca4ae3d0b, user.id=aa7a2fa0bb6b4907950091efcf341ae9, scope.system=all) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:54.892316 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f2e6d-b17b-4435-bc79-0eb712a1c76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:54.893949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f2e6d-b17b-4435-bc79-0eb712a1c76b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:54.899200 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 140/278] 10.222.0.52 () {56 vars in 1308 bytes} [Sat Sep 17 20:37:54 2022] GET /identity/v3/role_assignments?user.id=aa7a2fa0bb6b4907950091efcf341ae9&scope.system=all&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:54.942194 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 139/279] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:37:54 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:55.247588 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89600a-a457-4fd3-aa66-025fcb2bddbb None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:55.248284 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89600a-a457-4fd3-aa66-025fcb2bddbb None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:55.248767 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89600a-a457-4fd3-aa66-025fcb2bddbb None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:55.250652 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 141/280] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:55.256401 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e964d-ea92-48c2-a2ca-f4ea269a13c5 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:55.256935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e964d-ea92-48c2-a2ca-f4ea269a13c5 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:55.257464 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e964d-ea92-48c2-a2ca-f4ea269a13c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:55.286021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-fe7e964d-ea92-48c2-a2ca-f4ea269a13c5 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:55.287691 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-fe7e964d-ea92-48c2-a2ca-f4ea269a13c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:55.309566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:55.363244 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 140/281] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:55.710403 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c752-ca6d-4c3e-827c-5baa293aebf9 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:55.710929 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c752-ca6d-4c3e-827c-5baa293aebf9 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:55.710929 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c752-ca6d-4c3e-827c-5baa293aebf9 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:55.713058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 142/282] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:55.718718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c7e50-61b8-4ba4-a6f8-0eff53cf50c5 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:55.719127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c7e50-61b8-4ba4-a6f8-0eff53cf50c5 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:55.719503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c7e50-61b8-4ba4-a6f8-0eff53cf50c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:55.741445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-a36c7e50-61b8-4ba4-a6f8-0eff53cf50c5 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:55.742634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-a36c7e50-61b8-4ba4-a6f8-0eff53cf50c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:55.779955 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1c752-ca6d-4c3e-827c-5baa293aebf9 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:55.855144 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 141/283] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:55.882991 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:55.936204 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1c752-ca6d-4c3e-827c-5baa293aebf9 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:55.984142 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab17fc2-de23-4b8e-a6f3-ee182dd0a145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:55.984705 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab17fc2-de23-4b8e-a6f3-ee182dd0a145 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:55.984986 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab17fc2-de23-4b8e-a6f3-ee182dd0a145 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:55.985292 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab17fc2-de23-4b8e-a6f3-ee182dd0a145 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:55.999320 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab17fc2-de23-4b8e-a6f3-ee182dd0a145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-2ab17fc2-de23-4b8e-a6f3-ee182dd0a145 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:56.005361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:56.006231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:56.007015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 143/284] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:37:56.014601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c7e50-61b8-4ba4-a6f8-0eff53cf50c5 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:56.160225 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:56.177940 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c7e50-61b8-4ba4-a6f8-0eff53cf50c5 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:56.227903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe695b7-de99-4d42-bc6c-0fe6ffc1b7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:56.228465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe695b7-de99-4d42-bc6c-0fe6ffc1b7fc None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:56.228745 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe695b7-de99-4d42-bc6c-0fe6ffc1b7fc None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:56.229016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe695b7-de99-4d42-bc6c-0fe6ffc1b7fc None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:56.229709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe695b7-de99-4d42-bc6c-0fe6ffc1b7fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:56.230017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe695b7-de99-4d42-bc6c-0fe6ffc1b7fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:56.231420 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe695b7-de99-4d42-bc6c-0fe6ffc1b7fc None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:56.244586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 142/285] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:56.250148 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab17fc2-de23-4b8e-a6f3-ee182dd0a145 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:56.356304 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe695b7-de99-4d42-bc6c-0fe6ffc1b7fc None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:56.386671 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab17fc2-de23-4b8e-a6f3-ee182dd0a145 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:56.430512 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:56.447816 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f6be-0776-4164-9a0e-468a9c4f7be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:56.448738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f6be-0776-4164-9a0e-468a9c4f7be0 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:56.449252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f6be-0776-4164-9a0e-468a9c4f7be0 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:56.449745 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f6be-0776-4164-9a0e-468a9c4f7be0 None admin] PATH_INFO: `/v3/users/64f2114a0ea34d91b34a3e93298bc86b` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:56.451067 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61f6be-0776-4164-9a0e-468a9c4f7be0 None admin] RBAC: Authorizing `identity:get_user(user_id=64f2114a0ea34d91b34a3e93298bc86b)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:56.458564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61f6be-0776-4164-9a0e-468a9c4f7be0 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:56.461005 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 144/286] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:56 2022] GET /identity/v3/users/64f2114a0ea34d91b34a3e93298bc86b => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:56.470539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f6be-0776-4164-9a0e-468a9c4f7be0 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:56.499138 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe695b7-de99-4d42-bc6c-0fe6ffc1b7fc None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:56.534925 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525fc80-d730-4eb5-9714-b3bcc01b15f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:56.535559 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525fc80-d730-4eb5-9714-b3bcc01b15f6 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:56.535838 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525fc80-d730-4eb5-9714-b3bcc01b15f6 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:56.536109 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525fc80-d730-4eb5-9714-b3bcc01b15f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:56.559488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525fc80-d730-4eb5-9714-b3bcc01b15f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-2525fc80-d730-4eb5-9714-b3bcc01b15f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:56.566884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:56.568098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:56.568948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 143/287] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:37:56.575701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525fc80-d730-4eb5-9714-b3bcc01b15f6 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:56.596206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:56.675115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f6be-0776-4164-9a0e-468a9c4f7be0 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:56.725230 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad9dc8-fe42-47e7-a77b-647e016d86f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:56.725856 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad9dc8-fe42-47e7-a77b-647e016d86f8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:56.726133 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad9dc8-fe42-47e7-a77b-647e016d86f8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:56.726827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad9dc8-fe42-47e7-a77b-647e016d86f8 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:56.728756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad9dc8-fe42-47e7-a77b-647e016d86f8 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:56.730461 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad9dc8-fe42-47e7-a77b-647e016d86f8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:56.733121 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 145/288] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:56 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:56.738504 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad9dc8-fe42-47e7-a77b-647e016d86f8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:56.754181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525fc80-d730-4eb5-9714-b3bcc01b15f6 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:56.827781 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cf152-e3de-439b-95be-0e099127c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:56.828440 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cf152-e3de-439b-95be-0e099127c891 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:56.828718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cf152-e3de-439b-95be-0e099127c891 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:56.829042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cf152-e3de-439b-95be-0e099127c891 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:56.829741 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cf152-e3de-439b-95be-0e099127c891 None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:56.830044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cf152-e3de-439b-95be-0e099127c891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:56.831433 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cf152-e3de-439b-95be-0e099127c891 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:56.850003 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 144/289] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:56.852165 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cf152-e3de-439b-95be-0e099127c891 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:56.876182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:56.926051 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad9dc8-fe42-47e7-a77b-647e016d86f8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:56.953686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:56.963970 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cf152-e3de-439b-95be-0e099127c891 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:56.998531 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004475a-2f64-455c-8926-a5667ced5440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:56.999206 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004475a-2f64-455c-8926-a5667ced5440 None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:56.999480 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004475a-2f64-455c-8926-a5667ced5440 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:56.999750 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004475a-2f64-455c-8926-a5667ced5440 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/users/64f2114a0ea34d91b34a3e93298bc86b/roles/bf255d5513714f5e9f7841fe571300be` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:57.001699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004475a-2f64-455c-8926-a5667ced5440 None admin] RBAC: Authorizing `identity:create_grant(project_id=72850c3bcfc74a83ab924bd3fd1748ad, user_id=64f2114a0ea34d91b34a3e93298bc86b, role_id=bf255d5513714f5e9f7841fe571300be)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:57.003127 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004475a-2f64-455c-8926-a5667ced5440 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:57.035877 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dddc3-67fd-4ba4-93ec-d1b32cf94ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:57.035877 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dddc3-67fd-4ba4-93ec-d1b32cf94ddf None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:57.035877 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dddc3-67fd-4ba4-93ec-d1b32cf94ddf None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:57.035877 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dddc3-67fd-4ba4-93ec-d1b32cf94ddf None admin] PATH_INFO: `/v3/users/56992252992b43ac9ae86174cebc9146` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:57.036283 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dddc3-67fd-4ba4-93ec-d1b32cf94ddf None admin] RBAC: Authorizing `identity:get_user(user_id=56992252992b43ac9ae86174cebc9146)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:57.037893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dddc3-67fd-4ba4-93ec-d1b32cf94ddf None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:57.039708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 145/290] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:56 2022] GET /identity/v3/users/56992252992b43ac9ae86174cebc9146 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:57.051072 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dddc3-67fd-4ba4-93ec-d1b32cf94ddf None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:57.110491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 146/291] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:37:56 2022] PUT /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/users/64f2114a0ea34d91b34a3e93298bc86b/roles/bf255d5513714f5e9f7841fe571300be => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 20:37:57.310137 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dddc3-67fd-4ba4-93ec-d1b32cf94ddf None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:57.395153 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0576934-19c1-4745-8916-d1bfbf0b4ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:57.396037 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0576934-19c1-4745-8916-d1bfbf0b4ff8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:57.396646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0576934-19c1-4745-8916-d1bfbf0b4ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:57.397098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0576934-19c1-4745-8916-d1bfbf0b4ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:57.418775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:57.514187 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0576934-19c1-4745-8916-d1bfbf0b4ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:57.517306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0576934-19c1-4745-8916-d1bfbf0b4ff8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:57.657238 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 146/292] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:37:57.666564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004475a-2f64-455c-8926-a5667ced5440 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:57.839784 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004475a-2f64-455c-8926-a5667ced5440 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:57.869426 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:57.882066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd8c9-9aba-4b88-9d2a-4c26e2869479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:57.883263 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd8c9-9aba-4b88-9d2a-4c26e2869479 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:57.884545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd8c9-9aba-4b88-9d2a-4c26e2869479 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:57.888489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd8c9-9aba-4b88-9d2a-4c26e2869479 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:57.888489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd8c9-9aba-4b88-9d2a-4c26e2869479 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:57.889554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd8c9-9aba-4b88-9d2a-4c26e2869479 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:57.892217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 147/293] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:37:57 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:57.898156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0576934-19c1-4745-8916-d1bfbf0b4ff8 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:57.949640 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:58.038558 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0576934-19c1-4745-8916-d1bfbf0b4ff8 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:58.044012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78bd04-7141-49ab-a200-1f7eeb3c7632 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:58.044293 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78bd04-7141-49ab-a200-1f7eeb3c7632 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:58.044572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78bd04-7141-49ab-a200-1f7eeb3c7632 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:58.046246 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 148/294] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:37:58.051730 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0931ed-0023-4d8d-87f4-0a9831aa1859 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:58.052300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0931ed-0023-4d8d-87f4-0a9831aa1859 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:58.052777 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0931ed-0023-4d8d-87f4-0a9831aa1859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:58.075922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-fc0931ed-0023-4d8d-87f4-0a9831aa1859 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:58.084153 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-fc0931ed-0023-4d8d-87f4-0a9831aa1859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:58.087656 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b1d5a-5176-4e21-bfa8-ecf480388110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:58.088611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b1d5a-5176-4e21-bfa8-ecf480388110 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:58.089875 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b1d5a-5176-4e21-bfa8-ecf480388110 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:58.090308 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b1d5a-5176-4e21-bfa8-ecf480388110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:58.091207 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b1d5a-5176-4e21-bfa8-ecf480388110 None admin] RBAC: Adding query filter params (role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad, user.id=56992252992b43ac9ae86174cebc9146) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:58.091667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b1d5a-5176-4e21-bfa8-ecf480388110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:58.093274 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b1d5a-5176-4e21-bfa8-ecf480388110 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:58.099443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 147/295] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:37:57 2022] GET /identity/v3/role_assignments?user.id=56992252992b43ac9ae86174cebc9146&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:58.218843 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 149/296] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:37:58.356518 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655077e-c45f-4d86-8385-759ef4c925a2 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:58.357469 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655077e-c45f-4d86-8385-759ef4c925a2 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:58.358152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655077e-c45f-4d86-8385-759ef4c925a2 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:58.360545 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 148/297] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:58.372493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc187-f087-41a2-8e3c-9998a79f9a65 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:58.372807 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc187-f087-41a2-8e3c-9998a79f9a65 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:58.373057 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc187-f087-41a2-8e3c-9998a79f9a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:58.396550 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-181fc187-f087-41a2-8e3c-9998a79f9a65 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:58.398584 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-181fc187-f087-41a2-8e3c-9998a79f9a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:58.478745 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 150/298] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:58.504348 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c7c19-7e1d-4d9e-87be-5f16a821e33e None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:58.504348 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c7c19-7e1d-4d9e-87be-5f16a821e33e None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:58.504348 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c7c19-7e1d-4d9e-87be-5f16a821e33e None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:58.506212 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 149/299] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:37:58.513214 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7098f9-0f69-4100-b691-4e4b010b24a4 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:58.519597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7098f9-0f69-4100-b691-4e4b010b24a4 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:58.519597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7098f9-0f69-4100-b691-4e4b010b24a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:58.534521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-6d7098f9-0f69-4100-b691-4e4b010b24a4 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:37:58.535799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-6d7098f9-0f69-4100-b691-4e4b010b24a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:37:58.586663 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:58.612832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 151/300] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:37:58.716784 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c7c19-7e1d-4d9e-87be-5f16a821e33e None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:58.854948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7098f9-0f69-4100-b691-4e4b010b24a4 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:58.857923 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c7c19-7e1d-4d9e-87be-5f16a821e33e None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:58.859475 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:58.904083 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92ef91-3793-4584-baa5-b9c22e67dd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:58.904717 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92ef91-3793-4584-baa5-b9c22e67dd2b None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:58.905096 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92ef91-3793-4584-baa5-b9c22e67dd2b None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:58.905394 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92ef91-3793-4584-baa5-b9c22e67dd2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:58.916919 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92ef91-3793-4584-baa5-b9c22e67dd2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-7d92ef91-3793-4584-baa5-b9c22e67dd2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:58.922177 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:58.923042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:37:58.923817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:37:58.928141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 150/301] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:58.930126 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92ef91-3793-4584-baa5-b9c22e67dd2b None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:58.973328 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7098f9-0f69-4100-b691-4e4b010b24a4 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:59.014285 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04911e4-bb7a-4738-aa0c-57be8525b705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:59.014923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04911e4-bb7a-4738-aa0c-57be8525b705 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:59.015206 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04911e4-bb7a-4738-aa0c-57be8525b705 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:59.015479 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04911e4-bb7a-4738-aa0c-57be8525b705 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:59.016580 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04911e4-bb7a-4738-aa0c-57be8525b705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:59.018082 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04911e4-bb7a-4738-aa0c-57be8525b705 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:59.019639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 152/302] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:37:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:59.019639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04911e4-bb7a-4738-aa0c-57be8525b705 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:59.048324 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92ef91-3793-4584-baa5-b9c22e67dd2b None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:59.078438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:59.093077 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086abf0-979a-4ea4-992f-e7a6348cc407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:59.103088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086abf0-979a-4ea4-992f-e7a6348cc407 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:59.103088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086abf0-979a-4ea4-992f-e7a6348cc407 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:59.103088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086abf0-979a-4ea4-992f-e7a6348cc407 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:59.103088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086abf0-979a-4ea4-992f-e7a6348cc407 None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:59.103088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086abf0-979a-4ea4-992f-e7a6348cc407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:59.103088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086abf0-979a-4ea4-992f-e7a6348cc407 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:59.106536 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 151/303] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:59.111242 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086abf0-979a-4ea4-992f-e7a6348cc407 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:59.132902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04911e4-bb7a-4738-aa0c-57be8525b705 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:59.135659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:59.168083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1746d1-2b77-4abd-8bc1-9f93262133d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:59.183284 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1746d1-2b77-4abd-8bc1-9f93262133d3 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:59.183284 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1746d1-2b77-4abd-8bc1-9f93262133d3 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:59.183284 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1746d1-2b77-4abd-8bc1-9f93262133d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:59.183284 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1746d1-2b77-4abd-8bc1-9f93262133d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-ff1746d1-2b77-4abd-8bc1-9f93262133d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:37:59.184068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:37:59.184884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 153/304] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:37:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:37:59.186053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1746d1-2b77-4abd-8bc1-9f93262133d3 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:59.219592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086abf0-979a-4ea4-992f-e7a6348cc407 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:59.254567 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931d69e-2766-44aa-a26a-8f47b8dcfff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:59.255173 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931d69e-2766-44aa-a26a-8f47b8dcfff7 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:59.255450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931d69e-2766-44aa-a26a-8f47b8dcfff7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:59.255750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931d69e-2766-44aa-a26a-8f47b8dcfff7 None admin] PATH_INFO: `/v3/groups` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:59.256370 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931d69e-2766-44aa-a26a-8f47b8dcfff7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:59.257847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931d69e-2766-44aa-a26a-8f47b8dcfff7 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:59.294917 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1746d1-2b77-4abd-8bc1-9f93262133d3 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:59.303591 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:59.328054 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1a368-a89c-43fd-83b5-6a4af82de951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:59.328750 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1a368-a89c-43fd-83b5-6a4af82de951 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:59.328978 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1a368-a89c-43fd-83b5-6a4af82de951 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:59.329293 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1a368-a89c-43fd-83b5-6a4af82de951 None admin] PATH_INFO: `/v3/users/aa7a2fa0bb6b4907950091efcf341ae9` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:59.330392 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1a368-a89c-43fd-83b5-6a4af82de951 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7a2fa0bb6b4907950091efcf341ae9)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:59.331832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1a368-a89c-43fd-83b5-6a4af82de951 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:59.333414 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 154/305] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:59 2022] GET /identity/v3/users/aa7a2fa0bb6b4907950091efcf341ae9 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:59.334171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1a368-a89c-43fd-83b5-6a4af82de951 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:59.358091 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 152/306] 10.222.0.52 () {60 vars in 1134 bytes} [Sat Sep 17 20:37:59 2022] POST /identity/v3/groups => generated 229 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:37:59.359470 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931d69e-2766-44aa-a26a-8f47b8dcfff7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:59.485442 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1a368-a89c-43fd-83b5-6a4af82de951 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:59.489150 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:59.508817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931d69e-2766-44aa-a26a-8f47b8dcfff7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:59.534594 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e39ec8-c57c-49d8-a19c-308820a8ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:59.535631 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39ec8-c57c-49d8-a19c-308820a8ed9e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:59.536072 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39ec8-c57c-49d8-a19c-308820a8ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:59.536554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39ec8-c57c-49d8-a19c-308820a8ed9e None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:59.537502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e39ec8-c57c-49d8-a19c-308820a8ed9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:59.537987 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e39ec8-c57c-49d8-a19c-308820a8ed9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:59.539530 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e39ec8-c57c-49d8-a19c-308820a8ed9e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:59.550417 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cf452-ae7f-4801-96e4-b656cb49f531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:59.551127 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 155/307] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:37:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:37:59.555879 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cf452-ae7f-4801-96e4-b656cb49f531 None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:59.556346 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e39ec8-c57c-49d8-a19c-308820a8ed9e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:59.556710 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cf452-ae7f-4801-96e4-b656cb49f531 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:59.557156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cf452-ae7f-4801-96e4-b656cb49f531 None admin] PATH_INFO: `/v3/system/users/aa7a2fa0bb6b4907950091efcf341ae9/roles/dc25b689a7f8405a807147fca4ae3d0b` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:59.559076 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cf452-ae7f-4801-96e4-b656cb49f531 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aa7a2fa0bb6b4907950091efcf341ae9, role_id=dc25b689a7f8405a807147fca4ae3d0b)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:59.562083 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cf452-ae7f-4801-96e4-b656cb49f531 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:59.608649 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:37:59.658949 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 153/308] 10.222.0.52 () {58 vars in 1334 bytes} [Sat Sep 17 20:37:59 2022] PUT /identity/v3/system/users/aa7a2fa0bb6b4907950091efcf341ae9/roles/dc25b689a7f8405a807147fca4ae3d0b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:37:59.675126 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e39ec8-c57c-49d8-a19c-308820a8ed9e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:59.717101 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1544c4-65d1-4375-b908-5326113f81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:59.717799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1544c4-65d1-4375-b908-5326113f81dd None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:59.718078 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1544c4-65d1-4375-b908-5326113f81dd None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:59.718348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1544c4-65d1-4375-b908-5326113f81dd None admin] PATH_INFO: `/v3/users/8aeb209180a34ee1848670cfc60a91e1` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:59.734852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1544c4-65d1-4375-b908-5326113f81dd None admin] RBAC: Authorizing `identity:get_user(user_id=8aeb209180a34ee1848670cfc60a91e1)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:59.736342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1544c4-65d1-4375-b908-5326113f81dd None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:59.738794 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 156/309] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:37:59 2022] GET /identity/v3/users/8aeb209180a34ee1848670cfc60a91e1 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:37:59.744846 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cf452-ae7f-4801-96e4-b656cb49f531 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:37:59.863118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cf452-ae7f-4801-96e4-b656cb49f531 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:37:59.902534 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c81c8-b834-41f4-a83e-ebdfa737e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:37:59.903166 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c81c8-b834-41f4-a83e-ebdfa737e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:37:59.903450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c81c8-b834-41f4-a83e-ebdfa737e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:37:59.903724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c81c8-b834-41f4-a83e-ebdfa737e6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:37:59.904456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c81c8-b834-41f4-a83e-ebdfa737e6b8 None admin] RBAC: Adding query filter params (role.id=bf255d5513714f5e9f7841fe571300be, user.id=8aeb209180a34ee1848670cfc60a91e1, scope.system=all) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:37:59.904768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c81c8-b834-41f4-a83e-ebdfa737e6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:37:59.906307 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c81c8-b834-41f4-a83e-ebdfa737e6b8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:37:59.912490 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 154/310] 10.222.0.52 () {56 vars in 1308 bytes} [Sat Sep 17 20:37:59 2022] GET /identity/v3/role_assignments?user.id=8aeb209180a34ee1848670cfc60a91e1&scope.system=all&role.id=bf255d5513714f5e9f7841fe571300be => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:00.052132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2cc57-4136-437a-9730-42ef05cd8466 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:00.053091 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2cc57-4136-437a-9730-42ef05cd8466 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:00.053586 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2cc57-4136-437a-9730-42ef05cd8466 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:00.055118 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 157/311] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:00.061687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c10f28-ab19-4f2e-b2d6-b22ce8acf533 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:00.062211 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c10f28-ab19-4f2e-b2d6-b22ce8acf533 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:00.062211 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c10f28-ab19-4f2e-b2d6-b22ce8acf533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:00.086306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-24c10f28-ab19-4f2e-b2d6-b22ce8acf533 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:00.088123 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-24c10f28-ab19-4f2e-b2d6-b22ce8acf533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:00.097354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:00.163765 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 155/312] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:00.499658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2cc57-4136-437a-9730-42ef05cd8466 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:00.600493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:00.607272 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2cc57-4136-437a-9730-42ef05cd8466 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:00.642855 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f3a18-389a-468b-9809-4f2d3cd3f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:00.643481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f3a18-389a-468b-9809-4f2d3cd3f19c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:00.643754 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f3a18-389a-468b-9809-4f2d3cd3f19c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:00.644020 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f3a18-389a-468b-9809-4f2d3cd3f19c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:00.654703 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f3a18-389a-468b-9809-4f2d3cd3f19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-bc8f3a18-389a-468b-9809-4f2d3cd3f19c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:00.659521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:00.660397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:00.661197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 158/313] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:00.669611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c10f28-ab19-4f2e-b2d6-b22ce8acf533 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:00.773633 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c10f28-ab19-4f2e-b2d6-b22ce8acf533 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:00.814655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90650c5f-ac34-4815-aef9-0db18251661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:00.815266 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90650c5f-ac34-4815-aef9-0db18251661e None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:00.815538 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90650c5f-ac34-4815-aef9-0db18251661e None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:00.815803 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90650c5f-ac34-4815-aef9-0db18251661e None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:00.816460 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90650c5f-ac34-4815-aef9-0db18251661e None admin] RBAC: Adding query filter params (name=reader) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:00.816755 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90650c5f-ac34-4815-aef9-0db18251661e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:00.818436 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90650c5f-ac34-4815-aef9-0db18251661e None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:00.827227 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 156/314] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:00.834513 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f3a18-389a-468b-9809-4f2d3cd3f19c None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:00.944175 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f3a18-389a-468b-9809-4f2d3cd3f19c None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:00.978196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c194-7d92-4b94-a38e-8cb2b0f57653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:00.978916 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c194-7d92-4b94-a38e-8cb2b0f57653 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:00.979190 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c194-7d92-4b94-a38e-8cb2b0f57653 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:00.979457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c194-7d92-4b94-a38e-8cb2b0f57653 None admin] PATH_INFO: `/v3/users/64f2114a0ea34d91b34a3e93298bc86b` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:00.980574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868c194-7d92-4b94-a38e-8cb2b0f57653 None admin] RBAC: Authorizing `identity:get_user(user_id=64f2114a0ea34d91b34a3e93298bc86b)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:00.982050 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868c194-7d92-4b94-a38e-8cb2b0f57653 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:00.983907 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 159/315] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:38:00 2022] GET /identity/v3/users/64f2114a0ea34d91b34a3e93298bc86b => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:00.990223 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90650c5f-ac34-4815-aef9-0db18251661e None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:01.013505 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:01.099559 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90650c5f-ac34-4815-aef9-0db18251661e None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:01.144418 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b5b79-b7f1-4408-9ccd-f18a05f708cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:01.145033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b5b79-b7f1-4408-9ccd-f18a05f708cb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:01.145342 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b5b79-b7f1-4408-9ccd-f18a05f708cb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:01.145612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b5b79-b7f1-4408-9ccd-f18a05f708cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:01.217905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b5b79-b7f1-4408-9ccd-f18a05f708cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:01.219389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b5b79-b7f1-4408-9ccd-f18a05f708cb None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:01.241529 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:01.326087 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 157/316] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:01.331696 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c194-7d92-4b94-a38e-8cb2b0f57653 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:01.363859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:01.445497 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c194-7d92-4b94-a38e-8cb2b0f57653 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:01.483906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ded9d-a7ec-41fc-861d-4bd2b7c6c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:01.484526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ded9d-a7ec-41fc-861d-4bd2b7c6c898 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:01.484804 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ded9d-a7ec-41fc-861d-4bd2b7c6c898 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:01.485073 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ded9d-a7ec-41fc-861d-4bd2b7c6c898 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:01.486217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ded9d-a7ec-41fc-861d-4bd2b7c6c898 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:01.487646 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ded9d-a7ec-41fc-861d-4bd2b7c6c898 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:01.489483 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 160/317] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:01 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:01.495965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b5b79-b7f1-4408-9ccd-f18a05f708cb None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:01.609050 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b5b79-b7f1-4408-9ccd-f18a05f708cb None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:01.611374 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:01.643604 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d03a-9e96-4909-aa68-69bec0562d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:01.644218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d03a-9e96-4909-aa68-69bec0562d55 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:01.644498 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d03a-9e96-4909-aa68-69bec0562d55 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:01.644767 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d03a-9e96-4909-aa68-69bec0562d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:01.645527 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d03a-9e96-4909-aa68-69bec0562d55 None admin] RBAC: Adding query filter params (role.id=bf255d5513714f5e9f7841fe571300be, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad, user.id=64f2114a0ea34d91b34a3e93298bc86b) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:01.645837 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d03a-9e96-4909-aa68-69bec0562d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:01.647269 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d03a-9e96-4909-aa68-69bec0562d55 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:01.653766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 158/318] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:01 2022] GET /identity/v3/role_assignments?user.id=64f2114a0ea34d91b34a3e93298bc86b&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=bf255d5513714f5e9f7841fe571300be => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:02.001665 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cdd8f-07f6-4cf0-9dc8-b7a8aa5d071c None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.002317 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cdd8f-07f6-4cf0-9dc8-b7a8aa5d071c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.002826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cdd8f-07f6-4cf0-9dc8-b7a8aa5d071c None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.004360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 161/319] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:02.010473 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fecfe-171f-4809-8ba8-a08b17e5f221 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.010762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fecfe-171f-4809-8ba8-a08b17e5f221 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.011038 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fecfe-171f-4809-8ba8-a08b17e5f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.030783 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-810fecfe-171f-4809-8ba8-a08b17e5f221 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:02.032030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-810fecfe-171f-4809-8ba8-a08b17e5f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:02.105048 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 159/320] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:02.248655 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdfd7d-110c-4f4b-8435-de36de27cff7 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.248969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdfd7d-110c-4f4b-8435-de36de27cff7 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.249237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdfd7d-110c-4f4b-8435-de36de27cff7 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.250699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 162/321] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:02.255678 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51705f-1019-44c4-b6fc-83ee94725663 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.255908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51705f-1019-44c4-b6fc-83ee94725663 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.256224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51705f-1019-44c4-b6fc-83ee94725663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.273865 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-5b51705f-1019-44c4-b6fc-83ee94725663 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:02.275146 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-5b51705f-1019-44c4-b6fc-83ee94725663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:02.341505 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 160/322] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:02.427988 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdfd7d-110c-4f4b-8435-de36de27cff7 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:02.463263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61864-2786-49a5-ad61-554bc1652d6e None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.463625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61864-2786-49a5-ad61-554bc1652d6e None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.464237 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61864-2786-49a5-ad61-554bc1652d6e None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.466268 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 161/323] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:02.471045 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba062a-64ec-4a25-89c0-fff36558251b None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.471423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba062a-64ec-4a25-89c0-fff36558251b None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.471610 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba062a-64ec-4a25-89c0-fff36558251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.495571 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-47ba062a-64ec-4a25-89c0-fff36558251b None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:02.496766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-47ba062a-64ec-4a25-89c0-fff36558251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:02.534397 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:02.540705 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:02.550339 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdfd7d-110c-4f4b-8435-de36de27cff7 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:02.586069 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf9404-54c9-4bd7-a7cf-04f3633aee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:02.587252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf9404-54c9-4bd7-a7cf-04f3633aee05 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.587652 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf9404-54c9-4bd7-a7cf-04f3633aee05 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.587881 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf9404-54c9-4bd7-a7cf-04f3633aee05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.589220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 162/324] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:02.589370 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf9404-54c9-4bd7-a7cf-04f3633aee05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:02.590689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf9404-54c9-4bd7-a7cf-04f3633aee05 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:02.592849 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 163/325] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:02.598009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba062a-64ec-4a25-89c0-fff36558251b None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:02.682146 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf9404-54c9-4bd7-a7cf-04f3633aee05 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:02.697286 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba062a-64ec-4a25-89c0-fff36558251b None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:02.735904 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfef8-44e6-47a8-a5f4-39b778e57e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:02.736501 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfef8-44e6-47a8-a5f4-39b778e57e49 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.736830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfef8-44e6-47a8-a5f4-39b778e57e49 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.737142 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfef8-44e6-47a8-a5f4-39b778e57e49 None admin] PATH_INFO: `/v3/groups` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.737794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bfef8-44e6-47a8-a5f4-39b778e57e49 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:02.739220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bfef8-44e6-47a8-a5f4-39b778e57e49 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:02.790535 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf9404-54c9-4bd7-a7cf-04f3633aee05 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:02.824800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693d95-42ec-4ae5-aaed-2f40f8e35569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:02.825460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693d95-42ec-4ae5-aaed-2f40f8e35569 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.825737 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693d95-42ec-4ae5-aaed-2f40f8e35569 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.826000 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693d95-42ec-4ae5-aaed-2f40f8e35569 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.835845 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00693d95-42ec-4ae5-aaed-2f40f8e35569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-00693d95-42ec-4ae5-aaed-2f40f8e35569 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:02.840906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:02.841900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:02.842711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 164/326] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:02.847616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693d95-42ec-4ae5-aaed-2f40f8e35569 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:02.869834 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:02.943016 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693d95-42ec-4ae5-aaed-2f40f8e35569 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:02.975428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6fb1-6414-4d6f-87f2-d4a97e022b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:02.976011 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6fb1-6414-4d6f-87f2-d4a97e022b07 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:02.976283 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6fb1-6414-4d6f-87f2-d4a97e022b07 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:02.976549 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6fb1-6414-4d6f-87f2-d4a97e022b07 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:02.978175 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6fb1-6414-4d6f-87f2-d4a97e022b07 None admin] RBAC: Adding query filter params (name=member) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:02.978175 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6fb1-6414-4d6f-87f2-d4a97e022b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:02.979500 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6fb1-6414-4d6f-87f2-d4a97e022b07 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:02.987399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 165/327] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:02.988156 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6fb1-6414-4d6f-87f2-d4a97e022b07 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:03.084523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6fb1-6414-4d6f-87f2-d4a97e022b07 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:03.094839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 163/328] 10.222.0.52 () {60 vars in 1134 bytes} [Sat Sep 17 20:38:02 2022] POST /identity/v3/groups => generated 226 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:38:03.095468 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfef8-44e6-47a8-a5f4-39b778e57e49 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:03.121236 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:03.126985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711373b-6d98-4cf8-b173-8df2982818c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:03.127902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711373b-6d98-4cf8-b173-8df2982818c6 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:03.128191 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711373b-6d98-4cf8-b173-8df2982818c6 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:03.128463 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711373b-6d98-4cf8-b173-8df2982818c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:03.136023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:03.143603 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711373b-6d98-4cf8-b173-8df2982818c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-7711373b-6d98-4cf8-b173-8df2982818c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:03.149799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:03.153545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:03.154333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 166/329] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:03.157578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711373b-6d98-4cf8-b173-8df2982818c6 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:03.216133 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfef8-44e6-47a8-a5f4-39b778e57e49 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:03.254598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d94bd-26fa-44f1-b243-96bf5a659e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:03.255235 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d94bd-26fa-44f1-b243-96bf5a659e78 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:03.255514 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d94bd-26fa-44f1-b243-96bf5a659e78 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:03.255784 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d94bd-26fa-44f1-b243-96bf5a659e78 None admin] PATH_INFO: `/v3/users/aa7a2fa0bb6b4907950091efcf341ae9` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:03.256947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d94bd-26fa-44f1-b243-96bf5a659e78 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7a2fa0bb6b4907950091efcf341ae9)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:03.258441 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d94bd-26fa-44f1-b243-96bf5a659e78 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:03.260234 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 164/330] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:38:03 2022] GET /identity/v3/users/aa7a2fa0bb6b4907950091efcf341ae9 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:03.266466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d94bd-26fa-44f1-b243-96bf5a659e78 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:03.277723 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711373b-6d98-4cf8-b173-8df2982818c6 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:03.315626 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40364b-3a7b-4c11-beb0-7929dc210a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:03.315849 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40364b-3a7b-4c11-beb0-7929dc210a20 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:03.316233 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40364b-3a7b-4c11-beb0-7929dc210a20 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:03.317253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40364b-3a7b-4c11-beb0-7929dc210a20 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:03.317253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40364b-3a7b-4c11-beb0-7929dc210a20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:03.317827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40364b-3a7b-4c11-beb0-7929dc210a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:03.319102 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40364b-3a7b-4c11-beb0-7929dc210a20 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:03.329818 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 167/331] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:03.339126 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40364b-3a7b-4c11-beb0-7929dc210a20 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:03.343263 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:03.370931 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:03.390329 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d94bd-26fa-44f1-b243-96bf5a659e78 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:03.428134 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d4b78-7f0d-424a-a3f2-f4230a118a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:03.428742 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d4b78-7f0d-424a-a3f2-f4230a118a1a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:03.429020 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d4b78-7f0d-424a-a3f2-f4230a118a1a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:03.429326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d4b78-7f0d-424a-a3f2-f4230a118a1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:03.430047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d4b78-7f0d-424a-a3f2-f4230a118a1a None admin] RBAC: Adding query filter params (role.id=dc25b689a7f8405a807147fca4ae3d0b, user.id=aa7a2fa0bb6b4907950091efcf341ae9, scope.system=all) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:03.430879 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d4b78-7f0d-424a-a3f2-f4230a118a1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:03.432674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d4b78-7f0d-424a-a3f2-f4230a118a1a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:03.447033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 165/332] 10.222.0.52 () {56 vars in 1308 bytes} [Sat Sep 17 20:38:03 2022] GET /identity/v3/role_assignments?user.id=aa7a2fa0bb6b4907950091efcf341ae9&scope.system=all&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:03.463037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40364b-3a7b-4c11-beb0-7929dc210a20 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:03.509522 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e24729-6957-4e1e-b274-306690f87401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:03.510559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e24729-6957-4e1e-b274-306690f87401 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:03.511055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e24729-6957-4e1e-b274-306690f87401 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:03.511532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e24729-6957-4e1e-b274-306690f87401 None admin] PATH_INFO: `/v3/users/8aeb209180a34ee1848670cfc60a91e1` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:03.513061 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e24729-6957-4e1e-b274-306690f87401 None admin] RBAC: Authorizing `identity:get_user(user_id=8aeb209180a34ee1848670cfc60a91e1)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:03.514617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e24729-6957-4e1e-b274-306690f87401 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:03.516511 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 168/333] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:38:03 2022] GET /identity/v3/users/8aeb209180a34ee1848670cfc60a91e1 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:03.522274 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d4b78-7f0d-424a-a3f2-f4230a118a1a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:03.642969 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d4b78-7f0d-424a-a3f2-f4230a118a1a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:03.683578 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82ab7e-8d8c-48d0-9469-ee56a6f1d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:03.684241 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82ab7e-8d8c-48d0-9469-ee56a6f1d44d None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:03.684517 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82ab7e-8d8c-48d0-9469-ee56a6f1d44d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:03.684787 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82ab7e-8d8c-48d0-9469-ee56a6f1d44d None admin] PATH_INFO: `/v3/system/users/8aeb209180a34ee1848670cfc60a91e1/roles/bf255d5513714f5e9f7841fe571300be` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:03.686261 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82ab7e-8d8c-48d0-9469-ee56a6f1d44d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8aeb209180a34ee1848670cfc60a91e1, role_id=bf255d5513714f5e9f7841fe571300be)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:03.687692 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82ab7e-8d8c-48d0-9469-ee56a6f1d44d None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:03.773918 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 166/334] 10.222.0.52 () {58 vars in 1334 bytes} [Sat Sep 17 20:38:03 2022] PUT /identity/v3/system/users/8aeb209180a34ee1848670cfc60a91e1/roles/bf255d5513714f5e9f7841fe571300be => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:05.917287 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036dd51-f4b9-48dd-a65a-5dcfc5d12e0b None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:05.917970 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036dd51-f4b9-48dd-a65a-5dcfc5d12e0b None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:05.917970 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036dd51-f4b9-48dd-a65a-5dcfc5d12e0b None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:05.919164 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 169/335] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:05.925334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48761938-46ea-4fa4-944a-57115d190ba2 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:05.925785 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48761938-46ea-4fa4-944a-57115d190ba2 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:05.925862 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48761938-46ea-4fa4-944a-57115d190ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:05.954180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-48761938-46ea-4fa4-944a-57115d190ba2 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:05.955392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-48761938-46ea-4fa4-944a-57115d190ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:05.957473 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:06.038926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 167/336] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:06.313482 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a310b-7272-4421-ab1a-ede4f18a30bd None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:06.314501 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a310b-7272-4421-ab1a-ede4f18a30bd None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:06.315296 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a310b-7272-4421-ab1a-ede4f18a30bd None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:06.318277 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 170/337] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:06.327653 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7b8b3-8cc5-4ddd-a3ec-6871fd05366a None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:06.328537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7b8b3-8cc5-4ddd-a3ec-6871fd05366a None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:06.329338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7b8b3-8cc5-4ddd-a3ec-6871fd05366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:06.366530 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-ccf7b8b3-8cc5-4ddd-a3ec-6871fd05366a None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:06.369465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-ccf7b8b3-8cc5-4ddd-a3ec-6871fd05366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:06.432937 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a310b-7272-4421-ab1a-ede4f18a30bd None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:06.525959 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 168/338] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:06.580297 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:06.627528 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a310b-7272-4421-ab1a-ede4f18a30bd None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:06.681959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492fc47-58ca-4669-8208-3c7f88927bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:06.682933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492fc47-58ca-4669-8208-3c7f88927bdb None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:06.683348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492fc47-58ca-4669-8208-3c7f88927bdb None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:06.683648 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492fc47-58ca-4669-8208-3c7f88927bdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:06.700072 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492fc47-58ca-4669-8208-3c7f88927bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-c492fc47-58ca-4669-8208-3c7f88927bdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:06.706428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:06.707360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:06.708132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 171/339] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:06.717005 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7b8b3-8cc5-4ddd-a3ec-6871fd05366a None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:06.902615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:06.972322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7b8b3-8cc5-4ddd-a3ec-6871fd05366a None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:07.053622 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50b41e-6b69-4576-8bfa-0f2bdd273ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:07.054643 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b41e-6b69-4576-8bfa-0f2bdd273ec2 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:07.055195 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b41e-6b69-4576-8bfa-0f2bdd273ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:07.056796 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b41e-6b69-4576-8bfa-0f2bdd273ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:07.058036 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50b41e-6b69-4576-8bfa-0f2bdd273ec2 None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:07.058582 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50b41e-6b69-4576-8bfa-0f2bdd273ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:07.061192 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50b41e-6b69-4576-8bfa-0f2bdd273ec2 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:07.081663 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 169/340] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:07.087720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492fc47-58ca-4669-8208-3c7f88927bdb None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:07.244415 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492fc47-58ca-4669-8208-3c7f88927bdb None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:07.288158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:07.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5047-4923-4198-ad78-142aba04695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:07.294564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5047-4923-4198-ad78-142aba04695e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:07.294835 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5047-4923-4198-ad78-142aba04695e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:07.295100 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5047-4923-4198-ad78-142aba04695e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:07.357195 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50b41e-6b69-4576-8bfa-0f2bdd273ec2 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:07.371400 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b5047-4923-4198-ad78-142aba04695e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:07.372887 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b5047-4923-4198-ad78-142aba04695e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:07.477956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 172/341] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:07.481692 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5047-4923-4198-ad78-142aba04695e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:07.528270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:07.599122 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50b41e-6b69-4576-8bfa-0f2bdd273ec2 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:07.644910 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:07.653481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5047-4923-4198-ad78-142aba04695e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:07.662054 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac516d-e942-4229-a868-c536969369c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:07.662708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac516d-e942-4229-a868-c536969369c0 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:07.662979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac516d-e942-4229-a868-c536969369c0 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:07.663428 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac516d-e942-4229-a868-c536969369c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:07.678700 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac516d-e942-4229-a868-c536969369c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-eeac516d-e942-4229-a868-c536969369c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:07.690726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:07.691839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:07.693068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:07.695345 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 170/342] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:38:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:07.705273 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac516d-e942-4229-a868-c536969369c0 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:07.714989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91930fa0-58f2-4486-9088-0cec05cc66e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:07.715679 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91930fa0-58f2-4486-9088-0cec05cc66e4 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:07.715957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91930fa0-58f2-4486-9088-0cec05cc66e4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:07.716229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91930fa0-58f2-4486-9088-0cec05cc66e4 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:07.717919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91930fa0-58f2-4486-9088-0cec05cc66e4 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:07.719469 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91930fa0-58f2-4486-9088-0cec05cc66e4 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:07.721923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 173/343] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:07 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:07.727392 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91930fa0-58f2-4486-9088-0cec05cc66e4 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:07.861801 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91930fa0-58f2-4486-9088-0cec05cc66e4 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:07.865362 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:07.896382 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac516d-e942-4229-a868-c536969369c0 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:07.902922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5890c-a25c-4329-ac33-df8536280148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:07.903864 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5890c-a25c-4329-ac33-df8536280148 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:07.904270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5890c-a25c-4329-ac33-df8536280148 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:07.904694 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5890c-a25c-4329-ac33-df8536280148 None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:07.913288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5890c-a25c-4329-ac33-df8536280148 None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:07.915197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5890c-a25c-4329-ac33-df8536280148 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:07.917071 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 174/344] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:07 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:07.923903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f96396-ffbd-40f1-aa55-12c610c064e9 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:07.924449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f96396-ffbd-40f1-aa55-12c610c064e9 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:07.924864 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f96396-ffbd-40f1-aa55-12c610c064e9 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:07.926609 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 175/345] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:07.927810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524bfa-173f-4686-9be2-b64b450b48ec None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:07.928226 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524bfa-173f-4686-9be2-b64b450b48ec None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:07.928650 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524bfa-173f-4686-9be2-b64b450b48ec None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:07.929997 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 176/346] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:07.931628 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81524bfa-173f-4686-9be2-b64b450b48ec None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:07.945149 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99306a45-19e7-413e-8887-45ee4dde4779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:07.946656 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306a45-19e7-413e-8887-45ee4dde4779 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:07.947140 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306a45-19e7-413e-8887-45ee4dde4779 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:07.947681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306a45-19e7-413e-8887-45ee4dde4779 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:07.948515 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306a45-19e7-413e-8887-45ee4dde4779 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:07.949102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306a45-19e7-413e-8887-45ee4dde4779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:07.950676 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306a45-19e7-413e-8887-45ee4dde4779 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:07.960266 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 171/347] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:07.962000 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaae710-bb69-42d5-ae89-52fa1b655fa6 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:07.967323 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaae710-bb69-42d5-ae89-52fa1b655fa6 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:07.967988 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaae710-bb69-42d5-ae89-52fa1b655fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:07.988514 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-5eaae710-bb69-42d5-ae89-52fa1b655fa6 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:07.990532 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-5eaae710-bb69-42d5-ae89-52fa1b655fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:08.042181 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81524bfa-173f-4686-9be2-b64b450b48ec None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:08.047430 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:08.069530 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 172/348] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:08.074733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd94f1-6c65-4bf5-ab3e-286a4053e32c None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:08.075246 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd94f1-6c65-4bf5-ab3e-286a4053e32c None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:08.075898 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd94f1-6c65-4bf5-ab3e-286a4053e32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:08.077062 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56576a3-2c77-4092-8dde-f22796402766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:08.077704 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56576a3-2c77-4092-8dde-f22796402766 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:08.077978 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56576a3-2c77-4092-8dde-f22796402766 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:08.078244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56576a3-2c77-4092-8dde-f22796402766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:08.078963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56576a3-2c77-4092-8dde-f22796402766 None admin] RBAC: Adding query filter params (group.id=0a5a6b98827148c286a577087cee9fbe, role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=db23ab1161614bd8b0da96131a1fd283) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:08.079266 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56576a3-2c77-4092-8dde-f22796402766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:08.082063 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56576a3-2c77-4092-8dde-f22796402766 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:08.086595 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 177/349] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:07 2022] GET /identity/v3/role_assignments?group.id=0a5a6b98827148c286a577087cee9fbe&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:08.089901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56576a3-2c77-4092-8dde-f22796402766 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:08.116074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-4ddd94f1-6c65-4bf5-ab3e-286a4053e32c None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:08.119597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-4ddd94f1-6c65-4bf5-ab3e-286a4053e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:08.144225 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:08.227351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56576a3-2c77-4092-8dde-f22796402766 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:08.250206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 173/350] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:08.272957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11786-de5f-4cae-b21a-c140f238456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:08.273649 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11786-de5f-4cae-b21a-c140f238456a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:08.273953 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11786-de5f-4cae-b21a-c140f238456a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:08.274940 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11786-de5f-4cae-b21a-c140f238456a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:08.355764 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a11786-de5f-4cae-b21a-c140f238456a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:08.357205 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a11786-de5f-4cae-b21a-c140f238456a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:08.387753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:08.469216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 178/351] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:08.479197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd94f1-6c65-4bf5-ab3e-286a4053e32c None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:08.629792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd94f1-6c65-4bf5-ab3e-286a4053e32c None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:08.643427 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:08.668173 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a8aea-f2de-4b4a-a68e-6ce5da2e34d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:08.668808 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a8aea-f2de-4b4a-a68e-6ce5da2e34d2 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:08.669079 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a8aea-f2de-4b4a-a68e-6ce5da2e34d2 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:08.669388 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a8aea-f2de-4b4a-a68e-6ce5da2e34d2 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:08.670511 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a8aea-f2de-4b4a-a68e-6ce5da2e34d2 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:08.671979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a8aea-f2de-4b4a-a68e-6ce5da2e34d2 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:08.673938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 174/352] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:08 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:08.681769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11786-de5f-4cae-b21a-c140f238456a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:08.683898 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a8aea-f2de-4b4a-a68e-6ce5da2e34d2 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:08.866620 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11786-de5f-4cae-b21a-c140f238456a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:08.871586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a8aea-f2de-4b4a-a68e-6ce5da2e34d2 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:08.917402 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:08.929857 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc6688-adc3-4cf3-9af2-1cfbe89ba23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:08.931429 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3c13-9c54-4857-b99b-e41e67b8704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:08.933556 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3c13-9c54-4857-b99b-e41e67b8704b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:08.933556 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3c13-9c54-4857-b99b-e41e67b8704b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:08.933556 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3c13-9c54-4857-b99b-e41e67b8704b None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:08.933777 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6688-adc3-4cf3-9af2-1cfbe89ba23a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:08.933777 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6688-adc3-4cf3-9af2-1cfbe89ba23a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:08.933917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6688-adc3-4cf3-9af2-1cfbe89ba23a None admin] PATH_INFO: `/v3/roles/member` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:08.934989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f3c13-9c54-4857-b99b-e41e67b8704b None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:08.936430 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f3c13-9c54-4857-b99b-e41e67b8704b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:08.939778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 179/353] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:08 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:08.940786 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3c13-9c54-4857-b99b-e41e67b8704b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:08.959596 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc6688-adc3-4cf3-9af2-1cfbe89ba23a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-89dc6688-adc3-4cf3-9af2-1cfbe89ba23a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:08.964297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:08.965220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:08.966016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 175/354] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:08.966675 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc6688-adc3-4cf3-9af2-1cfbe89ba23a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:09.021718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:09.093574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3c13-9c54-4857-b99b-e41e67b8704b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:09.096797 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc6688-adc3-4cf3-9af2-1cfbe89ba23a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:09.139112 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792aa9fa-2987-41b9-9102-3cff301927fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:09.140341 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792aa9fa-2987-41b9-9102-3cff301927fc None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.140341 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792aa9fa-2987-41b9-9102-3cff301927fc None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.140548 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792aa9fa-2987-41b9-9102-3cff301927fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.141319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792aa9fa-2987-41b9-9102-3cff301927fc None admin] RBAC: Adding query filter params (group.id=0a5a6b98827148c286a577087cee9fbe, role.id=1245a77a23c14542b165310facdab5cd, scope.project.id=db23ab1161614bd8b0da96131a1fd283) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:09.141614 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792aa9fa-2987-41b9-9102-3cff301927fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:09.143062 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792aa9fa-2987-41b9-9102-3cff301927fc None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:09.145042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e1c34-3bff-452e-80eb-ea86f2a3f13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:09.145714 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1c34-3bff-452e-80eb-ea86f2a3f13b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.146444 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1c34-3bff-452e-80eb-ea86f2a3f13b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.146721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1c34-3bff-452e-80eb-ea86f2a3f13b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.148841 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 176/355] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:08 2022] GET /identity/v3/role_assignments?group.id=0a5a6b98827148c286a577087cee9fbe&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=1245a77a23c14542b165310facdab5cd => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:09.150008 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792aa9fa-2987-41b9-9102-3cff301927fc None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:09.173990 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e1c34-3bff-452e-80eb-ea86f2a3f13b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-5c2e1c34-3bff-452e-80eb-ea86f2a3f13b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:09.183434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:09.184410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 20:38:09.185250 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:09.187883 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 180/356] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:09.188375 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22351851-a79e-4c51-936a-86d99c843701 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.188657 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22351851-a79e-4c51-936a-86d99c843701 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.188934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22351851-a79e-4c51-936a-86d99c843701 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.190329 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 181/357] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:09.191473 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585b2f-fea8-4d93-8f96-aa55ff19047e None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.191968 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585b2f-fea8-4d93-8f96-aa55ff19047e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.192067 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585b2f-fea8-4d93-8f96-aa55ff19047e None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.197414 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 182/358] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:09.197414 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26585b2f-fea8-4d93-8f96-aa55ff19047e None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:09.278125 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:09.291706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792aa9fa-2987-41b9-9102-3cff301927fc None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:09.294805 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:09.329909 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d1ff-fdaf-4ded-a707-1cbffd5db3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:09.330835 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d1ff-fdaf-4ded-a707-1cbffd5db3fa None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.331086 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26585b2f-fea8-4d93-8f96-aa55ff19047e None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:09.331502 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d1ff-fdaf-4ded-a707-1cbffd5db3fa None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.331945 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d1ff-fdaf-4ded-a707-1cbffd5db3fa None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.332797 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d1ff-fdaf-4ded-a707-1cbffd5db3fa None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:09.333300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d1ff-fdaf-4ded-a707-1cbffd5db3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:09.334921 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d1ff-fdaf-4ded-a707-1cbffd5db3fa None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:09.344846 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 177/359] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:09.346622 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394ec9-5b70-4a80-a9e8-102490ae5fa2 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.347129 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394ec9-5b70-4a80-a9e8-102490ae5fa2 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.347617 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394ec9-5b70-4a80-a9e8-102490ae5fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.369662 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-97394ec9-5b70-4a80-a9e8-102490ae5fa2 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:09.371441 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-97394ec9-5b70-4a80-a9e8-102490ae5fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:09.371976 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f93e4-dd3a-4f15-97de-e591de76ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:09.372668 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f93e4-dd3a-4f15-97de-e591de76ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.372957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f93e4-dd3a-4f15-97de-e591de76ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.373312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f93e4-dd3a-4f15-97de-e591de76ceb8 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.373992 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f93e4-dd3a-4f15-97de-e591de76ceb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:09.374343 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f93e4-dd3a-4f15-97de-e591de76ceb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:09.375757 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f93e4-dd3a-4f15-97de-e591de76ceb8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:09.386202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 183/360] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:09.387269 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc77b1-91d7-4268-9d2c-25451e0fc2b4 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.387617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc77b1-91d7-4268-9d2c-25451e0fc2b4 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.387884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc77b1-91d7-4268-9d2c-25451e0fc2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.410109 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-ffbc77b1-91d7-4268-9d2c-25451e0fc2b4 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:09.411384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-ffbc77b1-91d7-4268-9d2c-25451e0fc2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:09.451091 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 178/361] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:09.452394 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97394ec9-5b70-4a80-a9e8-102490ae5fa2 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:09.490898 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 184/362] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:09.491879 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc77b1-91d7-4268-9d2c-25451e0fc2b4 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:09.548048 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:09.596794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:09.605383 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc77b1-91d7-4268-9d2c-25451e0fc2b4 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:09.607993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97394ec9-5b70-4a80-a9e8-102490ae5fa2 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:09.647497 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dd1b6-ca24-4155-8815-2e8f7af7b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:09.648134 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dd1b6-ca24-4155-8815-2e8f7af7b538 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.648413 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dd1b6-ca24-4155-8815-2e8f7af7b538 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.648686 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dd1b6-ca24-4155-8815-2e8f7af7b538 None admin] PATH_INFO: `/v3/users/8aeb209180a34ee1848670cfc60a91e1` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.650779 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dd1b6-ca24-4155-8815-2e8f7af7b538 None admin] RBAC: Authorizing `identity:get_user(user_id=8aeb209180a34ee1848670cfc60a91e1)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:09.652221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dd1b6-ca24-4155-8815-2e8f7af7b538 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:09.655814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 185/363] 10.222.0.52 () {56 vars in 1177 bytes} [Sat Sep 17 20:38:09 2022] GET /identity/v3/users/8aeb209180a34ee1848670cfc60a91e1 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:09.661644 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dd1b6-ca24-4155-8815-2e8f7af7b538 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:09.674295 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fa442-7518-4d97-9d4d-f55d7ad288fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:09.674913 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fa442-7518-4d97-9d4d-f55d7ad288fe None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.675192 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fa442-7518-4d97-9d4d-f55d7ad288fe None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.675464 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fa442-7518-4d97-9d4d-f55d7ad288fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.789200 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fa442-7518-4d97-9d4d-f55d7ad288fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:09.791365 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fa442-7518-4d97-9d4d-f55d7ad288fe None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:09.884777 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dd1b6-ca24-4155-8815-2e8f7af7b538 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:09.915639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:09.934767 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d88b9c-0d6a-4ba2-9ed6-60410ebfb8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:09.936793 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d88b9c-0d6a-4ba2-9ed6-60410ebfb8f4 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:09.936944 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d88b9c-0d6a-4ba2-9ed6-60410ebfb8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:09.938065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d88b9c-0d6a-4ba2-9ed6-60410ebfb8f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:09.939038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d88b9c-0d6a-4ba2-9ed6-60410ebfb8f4 None admin] RBAC: Adding query filter params (role.id=bf255d5513714f5e9f7841fe571300be, user.id=8aeb209180a34ee1848670cfc60a91e1, scope.system=all) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:09.939350 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d88b9c-0d6a-4ba2-9ed6-60410ebfb8f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:09.940950 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d88b9c-0d6a-4ba2-9ed6-60410ebfb8f4 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:09.968692 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 186/364] 10.222.0.52 () {56 vars in 1308 bytes} [Sat Sep 17 20:38:09 2022] GET /identity/v3/role_assignments?user.id=8aeb209180a34ee1848670cfc60a91e1&scope.system=all&role.id=bf255d5513714f5e9f7841fe571300be => generated 510 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:09.970961 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:09.980042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 179/365] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:09.985968 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d88b9c-0d6a-4ba2-9ed6-60410ebfb8f4 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:10.044586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fa442-7518-4d97-9d4d-f55d7ad288fe None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:10.111952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d88b9c-0d6a-4ba2-9ed6-60410ebfb8f4 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:10.151627 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee6f9-70a7-4826-9b4a-d5b3be52c09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:10.152227 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee6f9-70a7-4826-9b4a-d5b3be52c09d None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:10.152510 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee6f9-70a7-4826-9b4a-d5b3be52c09d None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:10.152784 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee6f9-70a7-4826-9b4a-d5b3be52c09d None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:10.154040 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ee6f9-70a7-4826-9b4a-d5b3be52c09d None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:10.155567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ee6f9-70a7-4826-9b4a-d5b3be52c09d None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:10.157910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 187/366] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:09 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:10.163634 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee6f9-70a7-4826-9b4a-d5b3be52c09d None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:10.194695 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fa442-7518-4d97-9d4d-f55d7ad288fe None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:10.215299 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:10.238874 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c0c5-6a70-4904-9475-044c78fea389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:10.239869 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c0c5-6a70-4904-9475-044c78fea389 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:10.240351 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c0c5-6a70-4904-9475-044c78fea389 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:10.240839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c0c5-6a70-4904-9475-044c78fea389 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:10.253280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93c0c5-6a70-4904-9475-044c78fea389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-5e93c0c5-6a70-4904-9475-044c78fea389 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:10.258634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:10.259947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:10.260730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:10.265576 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 180/367] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:10.266642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c0c5-6a70-4904-9475-044c78fea389 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:10.287869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee6f9-70a7-4826-9b4a-d5b3be52c09d None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:10.336175 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b2e19-0103-4e61-af18-4452d51942b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:10.337195 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2e19-0103-4e61-af18-4452d51942b9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:10.337492 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2e19-0103-4e61-af18-4452d51942b9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:10.337778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2e19-0103-4e61-af18-4452d51942b9 None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:10.339665 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:10.340904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b2e19-0103-4e61-af18-4452d51942b9 None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:10.342722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b2e19-0103-4e61-af18-4452d51942b9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:10.345589 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 188/368] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:10 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:10.346560 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b2e19-0103-4e61-af18-4452d51942b9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:10.404096 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c0c5-6a70-4904-9475-044c78fea389 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:10.453200 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03493e0-a320-4b2d-93f4-d13eb66ff64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:10.453860 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03493e0-a320-4b2d-93f4-d13eb66ff64b None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:10.454136 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03493e0-a320-4b2d-93f4-d13eb66ff64b None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:10.454406 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03493e0-a320-4b2d-93f4-d13eb66ff64b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:10.471696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03493e0-a320-4b2d-93f4-d13eb66ff64b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-d03493e0-a320-4b2d-93f4-d13eb66ff64b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:10.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:10.479616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 181/369] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:38:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:10.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03493e0-a320-4b2d-93f4-d13eb66ff64b None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:10.496189 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b2e19-0103-4e61-af18-4452d51942b9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:10.510846 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:10.548593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb09d26-4977-4d83-9a31-a5b98e2cd202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:10.549608 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb09d26-4977-4d83-9a31-a5b98e2cd202 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:10.549887 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb09d26-4977-4d83-9a31-a5b98e2cd202 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:10.550148 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb09d26-4977-4d83-9a31-a5b98e2cd202 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:10.551164 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb09d26-4977-4d83-9a31-a5b98e2cd202 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:10.551479 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb09d26-4977-4d83-9a31-a5b98e2cd202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:10.553819 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb09d26-4977-4d83-9a31-a5b98e2cd202 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:10.569052 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 189/370] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:10.570013 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb09d26-4977-4d83-9a31-a5b98e2cd202 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:10.632886 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03493e0-a320-4b2d-93f4-d13eb66ff64b None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:10.655181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:10.678244 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a2b9-585b-4ad8-91d2-6f12b7e4089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:10.678860 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a2b9-585b-4ad8-91d2-6f12b7e4089b None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:10.679223 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a2b9-585b-4ad8-91d2-6f12b7e4089b None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:10.679497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a2b9-585b-4ad8-91d2-6f12b7e4089b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:10.680830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a2b9-585b-4ad8-91d2-6f12b7e4089b None admin] RBAC: Adding query filter params (group.id=0a5a6b98827148c286a577087cee9fbe, role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:10.681144 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a2b9-585b-4ad8-91d2-6f12b7e4089b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:10.682615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a2b9-585b-4ad8-91d2-6f12b7e4089b None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:10.690007 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 182/371] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:10 2022] GET /identity/v3/role_assignments?group.id=0a5a6b98827148c286a577087cee9fbe&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:10.690893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a2b9-585b-4ad8-91d2-6f12b7e4089b None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:10.733253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb09d26-4977-4d83-9a31-a5b98e2cd202 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:10.810466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a2b9-585b-4ad8-91d2-6f12b7e4089b None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:10.810950 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfa4a4-66b9-4381-a37a-34d5cd90f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:10.811823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfa4a4-66b9-4381-a37a-34d5cd90f135 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:10.812301 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfa4a4-66b9-4381-a37a-34d5cd90f135 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:10.812772 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfa4a4-66b9-4381-a37a-34d5cd90f135 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:10.813680 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfa4a4-66b9-4381-a37a-34d5cd90f135 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:10.814190 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfa4a4-66b9-4381-a37a-34d5cd90f135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:10.815827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfa4a4-66b9-4381-a37a-34d5cd90f135 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:10.838747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 190/372] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:10.844476 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfa4a4-66b9-4381-a37a-34d5cd90f135 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:10.850364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659c70c-3e59-4c5a-b966-2b79947c7a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:10.851196 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659c70c-3e59-4c5a-b966-2b79947c7a5d None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:10.851481 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659c70c-3e59-4c5a-b966-2b79947c7a5d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:10.851825 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659c70c-3e59-4c5a-b966-2b79947c7a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:10.911231 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:10.924769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:10.935084 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659c70c-3e59-4c5a-b966-2b79947c7a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:10.936980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659c70c-3e59-4c5a-b966-2b79947c7a5d None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:11.051976 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 183/373] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:11.058343 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659c70c-3e59-4c5a-b966-2b79947c7a5d None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:11.083850 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfa4a4-66b9-4381-a37a-34d5cd90f135 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:11.127077 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ab94f-6405-4234-b88f-5f395d0fbd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:11.127743 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ab94f-6405-4234-b88f-5f395d0fbd6b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:11.128099 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ab94f-6405-4234-b88f-5f395d0fbd6b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:11.128541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ab94f-6405-4234-b88f-5f395d0fbd6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:11.148741 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:11.170079 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659c70c-3e59-4c5a-b966-2b79947c7a5d None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:11.208162 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ab94f-6405-4234-b88f-5f395d0fbd6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:11.208986 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a1f4b-818c-4070-ac5c-2fca0d6c8426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:11.209719 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a1f4b-818c-4070-ac5c-2fca0d6c8426 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:11.210134 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ab94f-6405-4234-b88f-5f395d0fbd6b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:11.210303 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a1f4b-818c-4070-ac5c-2fca0d6c8426 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:11.210739 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a1f4b-818c-4070-ac5c-2fca0d6c8426 None admin] PATH_INFO: `/v3/projects/a1449954a4a84885b4be97fe68c1c864` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:11.212789 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a1f4b-818c-4070-ac5c-2fca0d6c8426 None admin] RBAC: Authorizing `identity:get_project(project_id=a1449954a4a84885b4be97fe68c1c864)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:11.214698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a1f4b-818c-4070-ac5c-2fca0d6c8426 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:11.216795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 184/374] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:11 2022] GET /identity/v3/projects/a1449954a4a84885b4be97fe68c1c864 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:11.222508 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a1f4b-818c-4070-ac5c-2fca0d6c8426 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:11.248889 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:11.332133 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a1f4b-818c-4070-ac5c-2fca0d6c8426 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:11.352591 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 191/375] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 20:38:11.362191 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ab94f-6405-4234-b88f-5f395d0fbd6b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:11.370659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707921c-72b4-41a6-9423-ffa61d6bce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:11.371516 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707921c-72b4-41a6-9423-ffa61d6bce1f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:11.371961 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707921c-72b4-41a6-9423-ffa61d6bce1f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:11.372381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707921c-72b4-41a6-9423-ffa61d6bce1f None admin] PATH_INFO: `/v3/groups/84bd616231bd4e5aa7f7a586dde9251b` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:11.378967 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707921c-72b4-41a6-9423-ffa61d6bce1f None admin] RBAC: Authorizing `identity:get_group(group_id=84bd616231bd4e5aa7f7a586dde9251b)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:11.380614 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707921c-72b4-41a6-9423-ffa61d6bce1f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:11.382538 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 185/376] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:11 2022] GET /identity/v3/groups/84bd616231bd4e5aa7f7a586dde9251b => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:11.389600 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707921c-72b4-41a6-9423-ffa61d6bce1f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:11.409675 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:11.506574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707921c-72b4-41a6-9423-ffa61d6bce1f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:11.545263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05752509-7ea8-4028-9422-b1a391d6a3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:11.546214 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05752509-7ea8-4028-9422-b1a391d6a3a3 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:11.546665 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05752509-7ea8-4028-9422-b1a391d6a3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:11.547078 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05752509-7ea8-4028-9422-b1a391d6a3a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:11.548110 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05752509-7ea8-4028-9422-b1a391d6a3a3 None admin] RBAC: Adding query filter params (group.id=84bd616231bd4e5aa7f7a586dde9251b, role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=a1449954a4a84885b4be97fe68c1c864) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:11.548560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05752509-7ea8-4028-9422-b1a391d6a3a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:11.550227 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05752509-7ea8-4028-9422-b1a391d6a3a3 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:11.557370 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 186/377] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:11 2022] GET /identity/v3/role_assignments?group.id=84bd616231bd4e5aa7f7a586dde9251b&scope.project.id=a1449954a4a84885b4be97fe68c1c864&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:11.658015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ab94f-6405-4234-b88f-5f395d0fbd6b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:11.710986 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dfaa0-fab0-4d59-ad01-7ac8e4ef2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:11.712249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfaa0-fab0-4d59-ad01-7ac8e4ef2a65 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:11.712744 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfaa0-fab0-4d59-ad01-7ac8e4ef2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:11.713090 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfaa0-fab0-4d59-ad01-7ac8e4ef2a65 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:11.714414 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dfaa0-fab0-4d59-ad01-7ac8e4ef2a65 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:11.715872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dfaa0-fab0-4d59-ad01-7ac8e4ef2a65 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:11.717757 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 192/378] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:11 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:11.723687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05752509-7ea8-4028-9422-b1a391d6a3a3 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:11.865754 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:11.895422 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05752509-7ea8-4028-9422-b1a391d6a3a3 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:11.944812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22291066-b257-4a91-b37c-95dc1eb8edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:11.946380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22291066-b257-4a91-b37c-95dc1eb8edde None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:11.946891 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22291066-b257-4a91-b37c-95dc1eb8edde None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:11.947361 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22291066-b257-4a91-b37c-95dc1eb8edde None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:11.948716 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22291066-b257-4a91-b37c-95dc1eb8edde None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:11.950468 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22291066-b257-4a91-b37c-95dc1eb8edde None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:11.952698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 187/379] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:11 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:11.959732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dfaa0-fab0-4d59-ad01-7ac8e4ef2a65 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:11.963671 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:12.023515 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0461389-a0ab-44ed-9d8a-2b9781437756 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:12.024665 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0461389-a0ab-44ed-9d8a-2b9781437756 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:12.025324 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0461389-a0ab-44ed-9d8a-2b9781437756 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:12.027263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 188/380] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:12.033922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8df8f-106c-42a7-a584-419359cf4876 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:12.034483 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8df8f-106c-42a7-a584-419359cf4876 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:12.034954 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8df8f-106c-42a7-a584-419359cf4876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:12.056334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-7ab8df8f-106c-42a7-a584-419359cf4876 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:12.058315 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-7ab8df8f-106c-42a7-a584-419359cf4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:12.141905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 189/381] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:12.160597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dfaa0-fab0-4d59-ad01-7ac8e4ef2a65 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:12.205867 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045657fb-b1c9-46c2-9518-7b8c2bdd828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:12.206481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045657fb-b1c9-46c2-9518-7b8c2bdd828d None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:12.206767 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045657fb-b1c9-46c2-9518-7b8c2bdd828d None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:12.207048 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045657fb-b1c9-46c2-9518-7b8c2bdd828d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:12.207783 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045657fb-b1c9-46c2-9518-7b8c2bdd828d None admin] RBAC: Adding query filter params (group.id=0a5a6b98827148c286a577087cee9fbe, role.id=1245a77a23c14542b165310facdab5cd, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:12.208097 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045657fb-b1c9-46c2-9518-7b8c2bdd828d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:12.209580 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045657fb-b1c9-46c2-9518-7b8c2bdd828d None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:12.220208 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 193/382] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:11 2022] GET /identity/v3/role_assignments?group.id=0a5a6b98827148c286a577087cee9fbe&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=1245a77a23c14542b165310facdab5cd => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:12.553930 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8df8f-106c-42a7-a584-419359cf4876 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:12.642168 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:12.674947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8df8f-106c-42a7-a584-419359cf4876 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:12.717028 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac4ade-8c17-4f89-8024-d43b744a4266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:12.717706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac4ade-8c17-4f89-8024-d43b744a4266 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:12.717981 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac4ade-8c17-4f89-8024-d43b744a4266 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:12.718246 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac4ade-8c17-4f89-8024-d43b744a4266 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:12.729283 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac4ade-8c17-4f89-8024-d43b744a4266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-70ac4ade-8c17-4f89-8024-d43b744a4266 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:12.735326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:12.736181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:12.736941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 190/383] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:12.742833 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045657fb-b1c9-46c2-9518-7b8c2bdd828d None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:12.802689 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a4283-cd95-46e3-a8a9-636f7ca5cb74 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:12.803009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a4283-cd95-46e3-a8a9-636f7ca5cb74 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:12.803235 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a4283-cd95-46e3-a8a9-636f7ca5cb74 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:12.804731 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 191/384] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:12.812239 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd716ad-fc9c-4364-ab58-22c1a71f2f3e None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:12.812724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd716ad-fc9c-4364-ab58-22c1a71f2f3e None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:12.813218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd716ad-fc9c-4364-ab58-22c1a71f2f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:12.834473 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-9cd716ad-fc9c-4364-ab58-22c1a71f2f3e None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:12.836010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-9cd716ad-fc9c-4364-ab58-22c1a71f2f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:12.855547 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:12.925355 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045657fb-b1c9-46c2-9518-7b8c2bdd828d None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:12.965762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 192/385] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:12.988677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b8d94-3e3c-4acb-965a-5ba3637d9225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:12.989338 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b8d94-3e3c-4acb-965a-5ba3637d9225 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:12.989623 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b8d94-3e3c-4acb-965a-5ba3637d9225 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:12.989929 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b8d94-3e3c-4acb-965a-5ba3637d9225 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:12.990633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b8d94-3e3c-4acb-965a-5ba3637d9225 None admin] RBAC: Adding query filter params (name=member) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:12.990935 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b8d94-3e3c-4acb-965a-5ba3637d9225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:12.992304 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b8d94-3e3c-4acb-965a-5ba3637d9225 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:13.008309 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 194/386] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:13.013806 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd716ad-fc9c-4364-ab58-22c1a71f2f3e None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:13.118915 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:13.167713 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd716ad-fc9c-4364-ab58-22c1a71f2f3e None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:13.215514 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dc3bb-b1d8-46f2-9cb4-13677738a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:13.216156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dc3bb-b1d8-46f2-9cb4-13677738a073 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:13.216431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dc3bb-b1d8-46f2-9cb4-13677738a073 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:13.216697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dc3bb-b1d8-46f2-9cb4-13677738a073 None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:13.217870 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dc3bb-b1d8-46f2-9cb4-13677738a073 None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:13.219338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dc3bb-b1d8-46f2-9cb4-13677738a073 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:13.221200 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 193/387] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:13 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:13.226927 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b8d94-3e3c-4acb-965a-5ba3637d9225 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:13.361085 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b8d94-3e3c-4acb-965a-5ba3637d9225 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:13.388907 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:13.396781 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ef57a-4fa4-418f-8519-46d545b58fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:13.397427 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ef57a-4fa4-418f-8519-46d545b58fd0 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:13.397701 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ef57a-4fa4-418f-8519-46d545b58fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:13.397969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ef57a-4fa4-418f-8519-46d545b58fd0 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:13.399853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ef57a-4fa4-418f-8519-46d545b58fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:13.401447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ef57a-4fa4-418f-8519-46d545b58fd0 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:13.403365 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 195/388] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:13 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:13.409221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dc3bb-b1d8-46f2-9cb4-13677738a073 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:13.431579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ef57a-4fa4-418f-8519-46d545b58fd0 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:13.585565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ef57a-4fa4-418f-8519-46d545b58fd0 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:13.625998 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748590dc-1651-46c9-a3f1-e49a25eff59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:13.627074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748590dc-1651-46c9-a3f1-e49a25eff59b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:13.627556 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748590dc-1651-46c9-a3f1-e49a25eff59b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:13.630431 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748590dc-1651-46c9-a3f1-e49a25eff59b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:13.643742 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748590dc-1651-46c9-a3f1-e49a25eff59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-748590dc-1651-46c9-a3f1-e49a25eff59b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:13.650237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:13.651196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:13.651994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:13.655188 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 196/389] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:38:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:13.661766 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748590dc-1651-46c9-a3f1-e49a25eff59b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:13.681231 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dc3bb-b1d8-46f2-9cb4-13677738a073 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:13.745557 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:13.772750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:13.799311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748590dc-1651-46c9-a3f1-e49a25eff59b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:13.800824 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b0d54-d92a-4fd6-9ecb-b76f19967de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:13.802315 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b0d54-d92a-4fd6-9ecb-b76f19967de6 None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:13.802315 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b0d54-d92a-4fd6-9ecb-b76f19967de6 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:13.802315 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b0d54-d92a-4fd6-9ecb-b76f19967de6 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283/groups/0a5a6b98827148c286a577087cee9fbe/roles/dc25b689a7f8405a807147fca4ae3d0b` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:13.811438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b0d54-d92a-4fd6-9ecb-b76f19967de6 None admin] RBAC: Authorizing `identity:create_grant(project_id=db23ab1161614bd8b0da96131a1fd283, group_id=0a5a6b98827148c286a577087cee9fbe, role_id=dc25b689a7f8405a807147fca4ae3d0b)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:13.811438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b0d54-d92a-4fd6-9ecb-b76f19967de6 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:13.855930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d0567-1423-49d7-b46c-174e2c2f5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:13.857014 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d0567-1423-49d7-b46c-174e2c2f5044 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:13.857557 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d0567-1423-49d7-b46c-174e2c2f5044 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:13.858030 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d0567-1423-49d7-b46c-174e2c2f5044 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:13.858999 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d0567-1423-49d7-b46c-174e2c2f5044 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:13.859542 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d0567-1423-49d7-b46c-174e2c2f5044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:13.861253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d0567-1423-49d7-b46c-174e2c2f5044 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 197/390] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:13.876435 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d0567-1423-49d7-b46c-174e2c2f5044 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:13.945088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 194/391] 10.222.0.52 () {58 vars in 1442 bytes} [Sat Sep 17 20:38:13 2022] PUT /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283/groups/0a5a6b98827148c286a577087cee9fbe/roles/dc25b689a7f8405a807147fca4ae3d0b => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:14.013141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d0567-1423-49d7-b46c-174e2c2f5044 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:14.035749 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:14.055858 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21655799-7549-48dc-8d53-31f3f14b4957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:14.056597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21655799-7549-48dc-8d53-31f3f14b4957 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:14.056881 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21655799-7549-48dc-8d53-31f3f14b4957 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:14.057176 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21655799-7549-48dc-8d53-31f3f14b4957 None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:14.058456 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21655799-7549-48dc-8d53-31f3f14b4957 None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:14.060016 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21655799-7549-48dc-8d53-31f3f14b4957 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:14.061995 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 198/392] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:13 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:14.067332 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b0d54-d92a-4fd6-9ecb-b76f19967de6 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:14.206481 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b0d54-d92a-4fd6-9ecb-b76f19967de6 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:14.252517 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f917d-a1b3-46e9-9790-8f357723fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:14.253149 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f917d-a1b3-46e9-9790-8f357723fdba None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:14.253447 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f917d-a1b3-46e9-9790-8f357723fdba None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:14.253715 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f917d-a1b3-46e9-9790-8f357723fdba None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:14.254855 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f917d-a1b3-46e9-9790-8f357723fdba None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:14.256346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f917d-a1b3-46e9-9790-8f357723fdba None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:14.258983 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 195/393] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:14 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:14.265020 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21655799-7549-48dc-8d53-31f3f14b4957 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:14.357121 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b6490-991e-4608-90dd-29d1344ae599 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:14.357455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b6490-991e-4608-90dd-29d1344ae599 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:14.357692 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b6490-991e-4608-90dd-29d1344ae599 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:14.359250 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 196/394] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:14.365335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ecfb9-ac36-49a3-845a-3974e539902d None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:14.365925 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ecfb9-ac36-49a3-845a-3974e539902d None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:14.366400 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ecfb9-ac36-49a3-845a-3974e539902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:14.398403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-4b9ecfb9-ac36-49a3-845a-3974e539902d None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:14.400978 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-4b9ecfb9-ac36-49a3-845a-3974e539902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:14.415528 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21655799-7549-48dc-8d53-31f3f14b4957 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:14.455928 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd66b-b4f2-4441-a035-c5a91d9512f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:14.456845 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd66b-b4f2-4441-a035-c5a91d9512f4 None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:14.457069 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd66b-b4f2-4441-a035-c5a91d9512f4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:14.457377 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd66b-b4f2-4441-a035-c5a91d9512f4 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283/groups/0a5a6b98827148c286a577087cee9fbe/roles/1245a77a23c14542b165310facdab5cd` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:14.463588 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd66b-b4f2-4441-a035-c5a91d9512f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=db23ab1161614bd8b0da96131a1fd283, group_id=0a5a6b98827148c286a577087cee9fbe, role_id=1245a77a23c14542b165310facdab5cd)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:14.465390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd66b-b4f2-4441-a035-c5a91d9512f4 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:14.506647 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:14.520438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 197/395] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:14.546437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 199/396] 10.222.0.52 () {58 vars in 1442 bytes} [Sat Sep 17 20:38:14 2022] PUT /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283/groups/0a5a6b98827148c286a577087cee9fbe/roles/1245a77a23c14542b165310facdab5cd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:14.810820 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b0e12-a84c-43eb-abc5-de93a98cb924 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:14.811105 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b0e12-a84c-43eb-abc5-de93a98cb924 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:14.811319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b0e12-a84c-43eb-abc5-de93a98cb924 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:14.812914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 198/397] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:14.819562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9a6f1-b5b6-4774-81ad-9a10c690c48e None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:14.820119 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9a6f1-b5b6-4774-81ad-9a10c690c48e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:14.820690 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9a6f1-b5b6-4774-81ad-9a10c690c48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:14.840121 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-02c9a6f1-b5b6-4774-81ad-9a10c690c48e None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:14.841769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-02c9a6f1-b5b6-4774-81ad-9a10c690c48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:14.892256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:14.927252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 200/398] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:15.088083 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b0e12-a84c-43eb-abc5-de93a98cb924 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:15.208887 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b0e12-a84c-43eb-abc5-de93a98cb924 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:15.251247 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4f49e-c131-456c-acf0-d9ffb3e874d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:15.251883 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4f49e-c131-456c-acf0-d9ffb3e874d7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:15.252159 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4f49e-c131-456c-acf0-d9ffb3e874d7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:15.252423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4f49e-c131-456c-acf0-d9ffb3e874d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:15.263316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4f49e-c131-456c-acf0-d9ffb3e874d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-24c4f49e-c131-456c-acf0-d9ffb3e874d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:15.272255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:15.273141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:15.274900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 199/399] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:15.279862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9a6f1-b5b6-4774-81ad-9a10c690c48e None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:15.346008 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4f49e-c131-456c-acf0-d9ffb3e874d7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:15.436649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:15.463433 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9a6f1-b5b6-4774-81ad-9a10c690c48e None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:15.505481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a9bd4-7ddb-4c4d-bb73-0f7f71caae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:15.505830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4f49e-c131-456c-acf0-d9ffb3e874d7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:15.506060 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a9bd4-7ddb-4c4d-bb73-0f7f71caae11 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:15.506334 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a9bd4-7ddb-4c4d-bb73-0f7f71caae11 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:15.506599 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a9bd4-7ddb-4c4d-bb73-0f7f71caae11 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:15.507531 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a9bd4-7ddb-4c4d-bb73-0f7f71caae11 None admin] RBAC: Adding query filter params (name=member) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:15.507933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a9bd4-7ddb-4c4d-bb73-0f7f71caae11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:15.509980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a9bd4-7ddb-4c4d-bb73-0f7f71caae11 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:15.518989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 201/400] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:15.521885 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c693-e9ec-4ad8-a764-8d977d43915c None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:15.522285 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c693-e9ec-4ad8-a764-8d977d43915c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:15.522508 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c693-e9ec-4ad8-a764-8d977d43915c None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:15.524748 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 202/401] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:15.530160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731846-bdab-4684-8c0c-5e3228a2b950 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:15.530417 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731846-bdab-4684-8c0c-5e3228a2b950 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:15.530695 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731846-bdab-4684-8c0c-5e3228a2b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:15.545131 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7723ee-38ec-4ebd-bd68-7ca34e5f63fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:15.545787 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7723ee-38ec-4ebd-bd68-7ca34e5f63fa None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:15.546063 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7723ee-38ec-4ebd-bd68-7ca34e5f63fa None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:15.546331 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7723ee-38ec-4ebd-bd68-7ca34e5f63fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:15.548608 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-19731846-bdab-4684-8c0c-5e3228a2b950 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:15.549867 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-19731846-bdab-4684-8c0c-5e3228a2b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:15.562424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7723ee-38ec-4ebd-bd68-7ca34e5f63fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-5e7723ee-38ec-4ebd-bd68-7ca34e5f63fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:15.569519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:15.572363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 200/402] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:15.574310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7723ee-38ec-4ebd-bd68-7ca34e5f63fa None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:15.587379 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:15.627992 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 203/403] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:15.628738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731846-bdab-4684-8c0c-5e3228a2b950 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:15.755334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7723ee-38ec-4ebd-bd68-7ca34e5f63fa None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:15.776381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:15.792672 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731846-bdab-4684-8c0c-5e3228a2b950 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:15.826014 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcf4bd-5e08-4c63-8b6c-125ddd63540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:15.827735 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcf4bd-5e08-4c63-8b6c-125ddd63540d None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:15.828378 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcf4bd-5e08-4c63-8b6c-125ddd63540d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:15.829989 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcf4bd-5e08-4c63-8b6c-125ddd63540d None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:15.832061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcf4bd-5e08-4c63-8b6c-125ddd63540d None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:15.833732 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcf4bd-5e08-4c63-8b6c-125ddd63540d None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:15.838817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 201/404] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:15 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:15.845462 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcf4bd-5e08-4c63-8b6c-125ddd63540d None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:15.872730 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9668-ad60-4608-a04f-8a2202d5f753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:15.873705 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9668-ad60-4608-a04f-8a2202d5f753 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:15.874491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9668-ad60-4608-a04f-8a2202d5f753 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:15.875018 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9668-ad60-4608-a04f-8a2202d5f753 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:15.875873 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9668-ad60-4608-a04f-8a2202d5f753 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:15.876450 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9668-ad60-4608-a04f-8a2202d5f753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:15.878559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9668-ad60-4608-a04f-8a2202d5f753 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:15.889623 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 204/405] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:15.895604 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9668-ad60-4608-a04f-8a2202d5f753 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:15.953043 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:16.012349 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcf4bd-5e08-4c63-8b6c-125ddd63540d None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:16.070747 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8c0d8-d2e6-4867-bf2b-1965803243f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:16.071675 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8c0d8-d2e6-4867-bf2b-1965803243f9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:16.071955 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8c0d8-d2e6-4867-bf2b-1965803243f9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:16.072227 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8c0d8-d2e6-4867-bf2b-1965803243f9 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:16.073539 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8c0d8-d2e6-4867-bf2b-1965803243f9 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:16.074970 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8c0d8-d2e6-4867-bf2b-1965803243f9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:16.076711 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 202/406] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:15 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:16.077678 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8c0d8-d2e6-4867-bf2b-1965803243f9 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:16.093904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9668-ad60-4608-a04f-8a2202d5f753 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:16.137921 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:16.149314 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb0061-6914-43c8-8313-918c65979e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:16.155774 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb0061-6914-43c8-8313-918c65979e11 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:16.155774 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb0061-6914-43c8-8313-918c65979e11 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:16.155774 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb0061-6914-43c8-8313-918c65979e11 None admin] PATH_INFO: `/v3/groups/84bd616231bd4e5aa7f7a586dde9251b` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:16.155774 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb0061-6914-43c8-8313-918c65979e11 None admin] RBAC: Authorizing `identity:get_group(group_id=84bd616231bd4e5aa7f7a586dde9251b)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:16.155774 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb0061-6914-43c8-8313-918c65979e11 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:16.160210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 205/407] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:15 2022] GET /identity/v3/groups/84bd616231bd4e5aa7f7a586dde9251b => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:16.161154 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb0061-6914-43c8-8313-918c65979e11 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:16.213031 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8c0d8-d2e6-4867-bf2b-1965803243f9 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:16.259186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8db0-1b66-44c3-87b4-fbaf716675b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:16.260205 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8db0-1b66-44c3-87b4-fbaf716675b3 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:16.261189 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8db0-1b66-44c3-87b4-fbaf716675b3 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:16.261664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8db0-1b66-44c3-87b4-fbaf716675b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:16.270045 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:16.275240 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb0061-6914-43c8-8313-918c65979e11 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:16.275951 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf8db0-1b66-44c3-87b4-fbaf716675b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-90cf8db0-1b66-44c3-87b4-fbaf716675b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:16.282339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:16.283219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:16.284004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:16.290557 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 203/408] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:38:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:16.291602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8db0-1b66-44c3-87b4-fbaf716675b3 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:16.323593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421f5b9-cc86-4d55-8373-2a418a35f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:16.324434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421f5b9-cc86-4d55-8373-2a418a35f755 None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:16.324830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421f5b9-cc86-4d55-8373-2a418a35f755 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:16.325227 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421f5b9-cc86-4d55-8373-2a418a35f755 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/groups/0a5a6b98827148c286a577087cee9fbe/roles/dc25b689a7f8405a807147fca4ae3d0b` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:16.327805 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421f5b9-cc86-4d55-8373-2a418a35f755 None admin] RBAC: Authorizing `identity:create_grant(project_id=72850c3bcfc74a83ab924bd3fd1748ad, group_id=0a5a6b98827148c286a577087cee9fbe, role_id=dc25b689a7f8405a807147fca4ae3d0b)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:16.329546 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421f5b9-cc86-4d55-8373-2a418a35f755 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:16.418966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8db0-1b66-44c3-87b4-fbaf716675b3 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:16.428055 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:16.434747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 206/409] 10.222.0.52 () {58 vars in 1442 bytes} [Sat Sep 17 20:38:16 2022] PUT /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/groups/0a5a6b98827148c286a577087cee9fbe/roles/dc25b689a7f8405a807147fca4ae3d0b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:16.436231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421f5b9-cc86-4d55-8373-2a418a35f755 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:16.494098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e088-71ed-4009-92a4-d528227eb4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:16.494845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e088-71ed-4009-92a4-d528227eb4a5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:16.495128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e088-71ed-4009-92a4-d528227eb4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:16.495919 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e088-71ed-4009-92a4-d528227eb4a5 None admin] PATH_INFO: `/v3/projects/a1449954a4a84885b4be97fe68c1c864` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:16.498533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0e088-71ed-4009-92a4-d528227eb4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=a1449954a4a84885b4be97fe68c1c864)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:16.501576 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0e088-71ed-4009-92a4-d528227eb4a5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:16.504343 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 204/410] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:16 2022] GET /identity/v3/projects/a1449954a4a84885b4be97fe68c1c864 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:16.517839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e088-71ed-4009-92a4-d528227eb4a5 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:16.693518 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421f5b9-cc86-4d55-8373-2a418a35f755 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:16.714790 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e088-71ed-4009-92a4-d528227eb4a5 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:16.747192 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902a290-b718-4fc4-adb2-655f2c08f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:16.747949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902a290-b718-4fc4-adb2-655f2c08f620 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:16.748240 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902a290-b718-4fc4-adb2-655f2c08f620 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:16.748518 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902a290-b718-4fc4-adb2-655f2c08f620 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:16.749492 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902a290-b718-4fc4-adb2-655f2c08f620 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:16.749800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902a290-b718-4fc4-adb2-655f2c08f620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:16.751432 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902a290-b718-4fc4-adb2-655f2c08f620 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:16.755295 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423484b4-2cc2-463a-85be-4398f560d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:16.756220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423484b4-2cc2-463a-85be-4398f560d53c None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:16.756700 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423484b4-2cc2-463a-85be-4398f560d53c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:16.757197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423484b4-2cc2-463a-85be-4398f560d53c None admin] PATH_INFO: `/v3/projects/a1449954a4a84885b4be97fe68c1c864/groups/84bd616231bd4e5aa7f7a586dde9251b/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:16.760029 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423484b4-2cc2-463a-85be-4398f560d53c None admin] RBAC: Authorizing `identity:create_grant(project_id=a1449954a4a84885b4be97fe68c1c864, group_id=84bd616231bd4e5aa7f7a586dde9251b, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:16.761823 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423484b4-2cc2-463a-85be-4398f560d53c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:16.764474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 207/411] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:16.770469 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902a290-b718-4fc4-adb2-655f2c08f620 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:16.798431 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:16.844287 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 205/412] 10.222.0.52 () {58 vars in 1442 bytes} [Sat Sep 17 20:38:16 2022] PUT /identity/v3/projects/a1449954a4a84885b4be97fe68c1c864/groups/84bd616231bd4e5aa7f7a586dde9251b/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 20:38:16.846212 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc165a3c-0c9c-40d2-b116-fa27eeb4901c None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:16.846644 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc165a3c-0c9c-40d2-b116-fa27eeb4901c None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:16.847109 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc165a3c-0c9c-40d2-b116-fa27eeb4901c None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:16.848979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 206/413] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:16.856147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d98c70-be8d-4cd2-af71-5039498981b2 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:16.856837 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d98c70-be8d-4cd2-af71-5039498981b2 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:16.857342 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d98c70-be8d-4cd2-af71-5039498981b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:16.881755 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-52d98c70-be8d-4cd2-af71-5039498981b2 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:16.885052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-52d98c70-be8d-4cd2-af71-5039498981b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:16.939722 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:16.953737 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902a290-b718-4fc4-adb2-655f2c08f620 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:17.022003 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 207/414] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:17.035178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6b5d5-dd5a-4068-9765-0e17158be2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:17.035793 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6b5d5-dd5a-4068-9765-0e17158be2b9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:17.036188 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6b5d5-dd5a-4068-9765-0e17158be2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:17.036467 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6b5d5-dd5a-4068-9765-0e17158be2b9 None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:17.037806 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6b5d5-dd5a-4068-9765-0e17158be2b9 None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:17.040075 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6b5d5-dd5a-4068-9765-0e17158be2b9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:17.043158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 208/415] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:16 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:17.050180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d98c70-be8d-4cd2-af71-5039498981b2 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:17.196514 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d98c70-be8d-4cd2-af71-5039498981b2 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:17.246279 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c94df7-6d66-4702-8643-f8f81abe2833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:17.246894 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c94df7-6d66-4702-8643-f8f81abe2833 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:17.247118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c94df7-6d66-4702-8643-f8f81abe2833 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:17.247373 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c94df7-6d66-4702-8643-f8f81abe2833 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:17.249914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c94df7-6d66-4702-8643-f8f81abe2833 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:17.251412 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c94df7-6d66-4702-8643-f8f81abe2833 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:17.253233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 208/416] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:17 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:17.259584 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6b5d5-dd5a-4068-9765-0e17158be2b9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:17.392904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:17.405484 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6b5d5-dd5a-4068-9765-0e17158be2b9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:17.440186 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5d09-b45b-43da-a04b-6e32d82e4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:17.440851 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5d09-b45b-43da-a04b-6e32d82e4ef7 None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:17.441131 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5d09-b45b-43da-a04b-6e32d82e4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:17.441512 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5d09-b45b-43da-a04b-6e32d82e4ef7 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/groups/0a5a6b98827148c286a577087cee9fbe/roles/1245a77a23c14542b165310facdab5cd` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:17.443936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec5d09-b45b-43da-a04b-6e32d82e4ef7 None admin] RBAC: Authorizing `identity:create_grant(project_id=72850c3bcfc74a83ab924bd3fd1748ad, group_id=0a5a6b98827148c286a577087cee9fbe, role_id=1245a77a23c14542b165310facdab5cd)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:17.445397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec5d09-b45b-43da-a04b-6e32d82e4ef7 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:17.506510 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c94df7-6d66-4702-8643-f8f81abe2833 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:17.539267 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:17.551513 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 209/417] 10.222.0.52 () {58 vars in 1442 bytes} [Sat Sep 17 20:38:17 2022] PUT /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad/groups/0a5a6b98827148c286a577087cee9fbe/roles/1245a77a23c14542b165310facdab5cd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:17.623356 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c94df7-6d66-4702-8643-f8f81abe2833 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:17.660155 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dfce3-c232-44b3-854a-8d4bb7139f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:17.660801 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dfce3-c232-44b3-854a-8d4bb7139f0f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:17.661084 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dfce3-c232-44b3-854a-8d4bb7139f0f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:17.661379 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dfce3-c232-44b3-854a-8d4bb7139f0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:17.672698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dfce3-c232-44b3-854a-8d4bb7139f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-b19dfce3-c232-44b3-854a-8d4bb7139f0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:17.678588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:17.679377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 209/418] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:17.685850 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5d09-b45b-43da-a04b-6e32d82e4ef7 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:17.800703 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5d09-b45b-43da-a04b-6e32d82e4ef7 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:17.839945 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c331d-21ab-4f0e-9b79-49ab30ed0d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:17.840572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c331d-21ab-4f0e-9b79-49ab30ed0d2d None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:17.840854 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c331d-21ab-4f0e-9b79-49ab30ed0d2d None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:17.841129 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c331d-21ab-4f0e-9b79-49ab30ed0d2d None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:17.841839 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c331d-21ab-4f0e-9b79-49ab30ed0d2d None admin] RBAC: Adding query filter params (name=member) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:17.842146 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c331d-21ab-4f0e-9b79-49ab30ed0d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:17.843555 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c331d-21ab-4f0e-9b79-49ab30ed0d2d None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:17.854420 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 210/419] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:17.860082 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dfce3-c232-44b3-854a-8d4bb7139f0f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:17.873675 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3539f8-0255-4382-81ef-d8d6729bc521 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:17.873964 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3539f8-0255-4382-81ef-d8d6729bc521 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:17.874234 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3539f8-0255-4382-81ef-d8d6729bc521 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:17.875819 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 211/420] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:17.881034 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba321808-9c5c-4a46-9ec7-94137a2936ce None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:17.881403 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba321808-9c5c-4a46-9ec7-94137a2936ce None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:17.881677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba321808-9c5c-4a46-9ec7-94137a2936ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:17.904363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-ba321808-9c5c-4a46-9ec7-94137a2936ce None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:17.905682 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-ba321808-9c5c-4a46-9ec7-94137a2936ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:17.909825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:17.981204 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:17.989835 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dfce3-c232-44b3-854a-8d4bb7139f0f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:17.998114 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 212/421] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:18.030768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593f79c-b97e-446e-813b-46f422e59a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:18.031386 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593f79c-b97e-446e-813b-46f422e59a76 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:18.031665 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593f79c-b97e-446e-813b-46f422e59a76 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:18.031939 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593f79c-b97e-446e-813b-46f422e59a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:18.134971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593f79c-b97e-446e-813b-46f422e59a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:18.136364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593f79c-b97e-446e-813b-46f422e59a76 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:18.253936 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:18.266655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 210/422] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:18.272312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba321808-9c5c-4a46-9ec7-94137a2936ce None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:18.416562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba321808-9c5c-4a46-9ec7-94137a2936ce None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:18.445796 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593f79c-b97e-446e-813b-46f422e59a76 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:18.484423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e2eb3-e5d8-4d2a-96c9-3a5bb3946470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:18.485081 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e2eb3-e5d8-4d2a-96c9-3a5bb3946470 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:18.485356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e2eb3-e5d8-4d2a-96c9-3a5bb3946470 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:18.485623 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e2eb3-e5d8-4d2a-96c9-3a5bb3946470 None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:18.487463 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e2eb3-e5d8-4d2a-96c9-3a5bb3946470 None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:18.488896 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e2eb3-e5d8-4d2a-96c9-3a5bb3946470 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:18.490866 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 213/423] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:18 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:18.496298 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e2eb3-e5d8-4d2a-96c9-3a5bb3946470 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:18.514039 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:18.621422 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593f79c-b97e-446e-813b-46f422e59a76 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:18.651615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e2eb3-e5d8-4d2a-96c9-3a5bb3946470 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:18.678807 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c06b5-c097-47bc-b7c1-3a55134aae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:18.679728 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c06b5-c097-47bc-b7c1-3a55134aae38 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:18.680357 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c06b5-c097-47bc-b7c1-3a55134aae38 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:18.680827 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c06b5-c097-47bc-b7c1-3a55134aae38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:18.701292 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c06b5-c097-47bc-b7c1-3a55134aae38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-b03c06b5-c097-47bc-b7c1-3a55134aae38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:18.706680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:18.713673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:18.714659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 211/424] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:38:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:18.717625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c06b5-c097-47bc-b7c1-3a55134aae38 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:18.717728 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c92c10-cc25-4417-9cd6-1b0d443e1296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:18.718270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c92c10-cc25-4417-9cd6-1b0d443e1296 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:18.718547 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c92c10-cc25-4417-9cd6-1b0d443e1296 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:18.718819 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c92c10-cc25-4417-9cd6-1b0d443e1296 None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:18.721883 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c92c10-cc25-4417-9cd6-1b0d443e1296 None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:18.723459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c92c10-cc25-4417-9cd6-1b0d443e1296 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:18.729279 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 214/425] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:18 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:18.731037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c92c10-cc25-4417-9cd6-1b0d443e1296 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:18.776152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:18.839346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c06b5-c097-47bc-b7c1-3a55134aae38 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:18.881940 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bdfb0-aaac-47d5-ba34-02cd8ae43a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:18.882563 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bdfb0-aaac-47d5-ba34-02cd8ae43a72 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:18.882846 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bdfb0-aaac-47d5-ba34-02cd8ae43a72 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:18.883282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bdfb0-aaac-47d5-ba34-02cd8ae43a72 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:18.887049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bdfb0-aaac-47d5-ba34-02cd8ae43a72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:18.887366 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bdfb0-aaac-47d5-ba34-02cd8ae43a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:18.888821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bdfb0-aaac-47d5-ba34-02cd8ae43a72 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:18.899516 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 212/426] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:18.905845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bdfb0-aaac-47d5-ba34-02cd8ae43a72 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:18.935658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:19.000247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c92c10-cc25-4417-9cd6-1b0d443e1296 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:19.019036 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bdfb0-aaac-47d5-ba34-02cd8ae43a72 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:19.055779 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a5403-c86f-4469-a96c-b10f0779b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:19.056396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a5403-c86f-4469-a96c-b10f0779b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:19.056681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a5403-c86f-4469-a96c-b10f0779b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:19.056959 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a5403-c86f-4469-a96c-b10f0779b8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:19.070069 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:19.072923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda2b1a-5eaa-429f-a938-f9cab302793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:19.073611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda2b1a-5eaa-429f-a938-f9cab302793e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:19.073890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda2b1a-5eaa-429f-a938-f9cab302793e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:19.074159 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda2b1a-5eaa-429f-a938-f9cab302793e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:19.074896 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda2b1a-5eaa-429f-a938-f9cab302793e None admin] RBAC: Adding query filter params (group.id=0a5a6b98827148c286a577087cee9fbe, role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=db23ab1161614bd8b0da96131a1fd283) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:19.075203 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda2b1a-5eaa-429f-a938-f9cab302793e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:19.076680 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda2b1a-5eaa-429f-a938-f9cab302793e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:19.099574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 215/427] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:18 2022] GET /identity/v3/role_assignments?group.id=0a5a6b98827148c286a577087cee9fbe&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 611 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:19.141487 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a5403-c86f-4469-a96c-b10f0779b8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:19.142986 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a5403-c86f-4469-a96c-b10f0779b8d5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:19.278329 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 213/428] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 20:38:19.284055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda2b1a-5eaa-429f-a938-f9cab302793e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:19.382728 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cc58e-b76b-4c6d-9e3c-652fb1910b24 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:19.383737 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cc58e-b76b-4c6d-9e3c-652fb1910b24 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:19.384246 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cc58e-b76b-4c6d-9e3c-652fb1910b24 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:19.400537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 214/429] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:19.400537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dbada-41fb-45b5-a1ea-4d9785499c54 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:19.400537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dbada-41fb-45b5-a1ea-4d9785499c54 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:19.400537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dbada-41fb-45b5-a1ea-4d9785499c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:19.425409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda2b1a-5eaa-429f-a938-f9cab302793e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:19.430868 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-744dbada-41fb-45b5-a1ea-4d9785499c54 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:19.432300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-744dbada-41fb-45b5-a1ea-4d9785499c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:19.451679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:19.478737 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65526903-3750-4405-911d-d6020621118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:19.479378 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65526903-3750-4405-911d-d6020621118a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:19.479660 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65526903-3750-4405-911d-d6020621118a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:19.479937 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65526903-3750-4405-911d-d6020621118a None admin] PATH_INFO: `/v3/projects/db23ab1161614bd8b0da96131a1fd283` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:19.481147 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65526903-3750-4405-911d-d6020621118a None admin] RBAC: Authorizing `identity:get_project(project_id=db23ab1161614bd8b0da96131a1fd283)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:19.483058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65526903-3750-4405-911d-d6020621118a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:19.484857 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 216/430] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:19 2022] GET /identity/v3/projects/db23ab1161614bd8b0da96131a1fd283 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:19.490097 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65526903-3750-4405-911d-d6020621118a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:19.503526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:19.533038 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 215/431] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:19.600781 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65526903-3750-4405-911d-d6020621118a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:19.638070 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82b11-6ddf-425d-a514-55e0e18f5240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:19.638697 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82b11-6ddf-425d-a514-55e0e18f5240 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:19.638978 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82b11-6ddf-425d-a514-55e0e18f5240 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:19.639251 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82b11-6ddf-425d-a514-55e0e18f5240 None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:19.640370 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82b11-6ddf-425d-a514-55e0e18f5240 None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:19.641919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82b11-6ddf-425d-a514-55e0e18f5240 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:19.643785 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 217/432] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:19 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:19.653872 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dbada-41fb-45b5-a1ea-4d9785499c54 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:19.772256 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dbada-41fb-45b5-a1ea-4d9785499c54 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:19.825150 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9216d6-e8bc-4ec3-a0c0-e2444e90e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:19.825904 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9216d6-e8bc-4ec3-a0c0-e2444e90e684 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:19.826190 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9216d6-e8bc-4ec3-a0c0-e2444e90e684 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:19.826462 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9216d6-e8bc-4ec3-a0c0-e2444e90e684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:19.827190 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9216d6-e8bc-4ec3-a0c0-e2444e90e684 None admin] RBAC: Adding query filter params (group.id=0a5a6b98827148c286a577087cee9fbe, role.id=1245a77a23c14542b165310facdab5cd, scope.project.id=db23ab1161614bd8b0da96131a1fd283) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:19.827497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9216d6-e8bc-4ec3-a0c0-e2444e90e684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:19.828986 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9216d6-e8bc-4ec3-a0c0-e2444e90e684 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:19.835317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 216/433] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:19 2022] GET /identity/v3/role_assignments?group.id=0a5a6b98827148c286a577087cee9fbe&scope.project.id=db23ab1161614bd8b0da96131a1fd283&role.id=1245a77a23c14542b165310facdab5cd => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:19.877421 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee40075-f68e-400e-af88-0454db8cc2e9 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:19.877736 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee40075-f68e-400e-af88-0454db8cc2e9 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:19.877973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee40075-f68e-400e-af88-0454db8cc2e9 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:19.879699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 218/434] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:19.885721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed58fa-276b-4975-8802-62d0d8ea6c5b None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:19.886076 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed58fa-276b-4975-8802-62d0d8ea6c5b None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:19.886351 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed58fa-276b-4975-8802-62d0d8ea6c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:19.906917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-13ed58fa-276b-4975-8802-62d0d8ea6c5b None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:19.908221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-13ed58fa-276b-4975-8802-62d0d8ea6c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:19.910568 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:19.940216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee40075-f68e-400e-af88-0454db8cc2e9 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:20.003645 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 217/435] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:20.083234 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:20.110305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee40075-f68e-400e-af88-0454db8cc2e9 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:20.152042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911d39-cbdc-49e9-ad0d-4555ff06ddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:20.152693 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911d39-cbdc-49e9-ad0d-4555ff06ddd8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:20.152974 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911d39-cbdc-49e9-ad0d-4555ff06ddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:20.153289 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911d39-cbdc-49e9-ad0d-4555ff06ddd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:20.165579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8911d39-cbdc-49e9-ad0d-4555ff06ddd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-f8911d39-cbdc-49e9-ad0d-4555ff06ddd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:20.171089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:20.171989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:20.172771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 219/436] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:20.178323 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed58fa-276b-4975-8802-62d0d8ea6c5b None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:20.295537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed58fa-276b-4975-8802-62d0d8ea6c5b None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:20.335344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5c96e-365a-448d-84b6-b208bb7006c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:20.335877 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5c96e-365a-448d-84b6-b208bb7006c5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:20.336784 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5c96e-365a-448d-84b6-b208bb7006c5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:20.337246 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5c96e-365a-448d-84b6-b208bb7006c5 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:20.338154 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5c96e-365a-448d-84b6-b208bb7006c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:20.338458 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5c96e-365a-448d-84b6-b208bb7006c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:20.339844 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5c96e-365a-448d-84b6-b208bb7006c5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:20.345423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:20.349366 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 218/437] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:38:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:20.354973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911d39-cbdc-49e9-ad0d-4555ff06ddd8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:20.404122 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5c96e-365a-448d-84b6-b208bb7006c5 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:20.487878 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911d39-cbdc-49e9-ad0d-4555ff06ddd8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:20.534121 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32b6f1-ab3b-4702-887c-ce7fd56cbf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:20.534718 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32b6f1-ab3b-4702-887c-ce7fd56cbf6c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:20.534990 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32b6f1-ab3b-4702-887c-ce7fd56cbf6c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:20.535263 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32b6f1-ab3b-4702-887c-ce7fd56cbf6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:20.538682 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:20.547217 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5c96e-365a-448d-84b6-b208bb7006c5 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:20.585235 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7f773-7c55-4e20-833f-fad731e60884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:20.585921 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7f773-7c55-4e20-833f-fad731e60884 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:20.586770 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7f773-7c55-4e20-833f-fad731e60884 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:20.587210 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7f773-7c55-4e20-833f-fad731e60884 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:20.597444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7f773-7c55-4e20-833f-fad731e60884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-19c7f773-7c55-4e20-833f-fad731e60884 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:20.603282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:20.604326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:20.605117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 219/438] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:20.605817 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32b6f1-ab3b-4702-887c-ce7fd56cbf6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:20.605891 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cd7f6-8391-4311-8b49-73be2387a636 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:20.606388 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cd7f6-8391-4311-8b49-73be2387a636 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:20.606388 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cd7f6-8391-4311-8b49-73be2387a636 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:20.606556 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32b6f1-ab3b-4702-887c-ce7fd56cbf6c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:20.607697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 220/439] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:20.610172 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cd7f6-8391-4311-8b49-73be2387a636 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:20.674011 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:20.718890 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cd7f6-8391-4311-8b49-73be2387a636 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:20.723824 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 220/440] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:20.725053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209dcdf-3f0b-435d-aeb0-ae566cd79c0e None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:20.725361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209dcdf-3f0b-435d-aeb0-ae566cd79c0e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:20.725643 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209dcdf-3f0b-435d-aeb0-ae566cd79c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:20.743239 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-d209dcdf-3f0b-435d-aeb0-ae566cd79c0e None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:20.744420 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-d209dcdf-3f0b-435d-aeb0-ae566cd79c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:20.752687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7645b-738e-4dc1-9235-7569e0458edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:20.753314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7645b-738e-4dc1-9235-7569e0458edb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:20.753591 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7645b-738e-4dc1-9235-7569e0458edb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:20.753859 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7645b-738e-4dc1-9235-7569e0458edb None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:20.754511 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7645b-738e-4dc1-9235-7569e0458edb None admin] RBAC: Adding query filter params (name=admin) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:20.754813 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7645b-738e-4dc1-9235-7569e0458edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:20.756176 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7645b-738e-4dc1-9235-7569e0458edb None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:20.764597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 221/441] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:20.765485 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7645b-738e-4dc1-9235-7569e0458edb None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:20.773419 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:20.813801 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 221/442] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:20.814797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209dcdf-3f0b-435d-aeb0-ae566cd79c0e None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:20.868889 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7645b-738e-4dc1-9235-7569e0458edb None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:20.891337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:20.902908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627d0c-4a91-4f2a-b78b-7c1974301342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:20.903527 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627d0c-4a91-4f2a-b78b-7c1974301342 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:20.906759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627d0c-4a91-4f2a-b78b-7c1974301342 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:20.906759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627d0c-4a91-4f2a-b78b-7c1974301342 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:20.906759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6627d0c-4a91-4f2a-b78b-7c1974301342 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:20.906759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6627d0c-4a91-4f2a-b78b-7c1974301342 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:20.908378 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 222/443] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:20 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:20.913674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627d0c-4a91-4f2a-b78b-7c1974301342 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:20.927385 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209dcdf-3f0b-435d-aeb0-ae566cd79c0e None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:20.965705 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794ada8-7a58-4cb6-ad70-b9a71549b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:20.966393 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794ada8-7a58-4cb6-ad70-b9a71549b2b1 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:20.966676 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794ada8-7a58-4cb6-ad70-b9a71549b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:20.966948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794ada8-7a58-4cb6-ad70-b9a71549b2b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:21.002812 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:21.022692 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627d0c-4a91-4f2a-b78b-7c1974301342 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:21.040756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794ada8-7a58-4cb6-ad70-b9a71549b2b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:21.042356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794ada8-7a58-4cb6-ad70-b9a71549b2b1 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:21.057393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f951-10f8-41b6-a61d-f1998f826ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:21.058016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f951-10f8-41b6-a61d-f1998f826ce7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:21.058294 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f951-10f8-41b6-a61d-f1998f826ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:21.058567 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f951-10f8-41b6-a61d-f1998f826ce7 None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:21.059711 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f951-10f8-41b6-a61d-f1998f826ce7 None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:21.061193 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f951-10f8-41b6-a61d-f1998f826ce7 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:21.062760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 223/444] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:20 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:21.068768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f951-10f8-41b6-a61d-f1998f826ce7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:21.131665 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:21.151274 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 222/445] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:21.152056 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794ada8-7a58-4cb6-ad70-b9a71549b2b1 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:21.175213 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f951-10f8-41b6-a61d-f1998f826ce7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:21.209649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cdbc7-f585-4317-92c0-a5b3764061da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:21.210246 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cdbc7-f585-4317-92c0-a5b3764061da None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:21.210531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cdbc7-f585-4317-92c0-a5b3764061da None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:21.210799 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cdbc7-f585-4317-92c0-a5b3764061da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:21.211600 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cdbc7-f585-4317-92c0-a5b3764061da None admin] RBAC: Adding query filter params (group.id=0a5a6b98827148c286a577087cee9fbe, role.id=dc25b689a7f8405a807147fca4ae3d0b, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:21.211908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cdbc7-f585-4317-92c0-a5b3764061da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:21.213406 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cdbc7-f585-4317-92c0-a5b3764061da None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:21.216618 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:21.219358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 224/446] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:21 2022] GET /identity/v3/role_assignments?group.id=0a5a6b98827148c286a577087cee9fbe&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=dc25b689a7f8405a807147fca4ae3d0b => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:21.220135 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cdbc7-f585-4317-92c0-a5b3764061da None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:21.254895 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794ada8-7a58-4cb6-ad70-b9a71549b2b1 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:21.293127 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d64a-5b79-46e6-9c25-1e2895eccade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:21.293809 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d64a-5b79-46e6-9c25-1e2895eccade None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:21.294092 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d64a-5b79-46e6-9c25-1e2895eccade None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:21.294367 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d64a-5b79-46e6-9c25-1e2895eccade None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:21.306356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d64a-5b79-46e6-9c25-1e2895eccade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-3c64d64a-5b79-46e6-9c25-1e2895eccade None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:21.311351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:21.314244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:21.315217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 223/447] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:38:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:21.319041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d64a-5b79-46e6-9c25-1e2895eccade None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:21.355079 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cdbc7-f585-4317-92c0-a5b3764061da None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:21.381511 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:21.397593 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b7a2-fa7c-4506-829a-282cc7a5bf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:21.398536 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b7a2-fa7c-4506-829a-282cc7a5bf27 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:21.399001 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b7a2-fa7c-4506-829a-282cc7a5bf27 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:21.399643 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b7a2-fa7c-4506-829a-282cc7a5bf27 None admin] PATH_INFO: `/v3/projects/a1449954a4a84885b4be97fe68c1c864` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:21.400652 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88b7a2-fa7c-4506-829a-282cc7a5bf27 None admin] RBAC: Authorizing `identity:get_project(project_id=a1449954a4a84885b4be97fe68c1c864)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:21.402138 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88b7a2-fa7c-4506-829a-282cc7a5bf27 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:21.403976 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 225/448] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:21 2022] GET /identity/v3/projects/a1449954a4a84885b4be97fe68c1c864 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:21.409633 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b7a2-fa7c-4506-829a-282cc7a5bf27 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:21.445408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d64a-5b79-46e6-9c25-1e2895eccade None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:21.478698 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:21.490664 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cedc5a-1122-477b-a55d-d97dcfb2ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:21.491254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cedc5a-1122-477b-a55d-d97dcfb2ae61 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:21.491582 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cedc5a-1122-477b-a55d-d97dcfb2ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:21.492195 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cedc5a-1122-477b-a55d-d97dcfb2ae61 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:21.492562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cedc5a-1122-477b-a55d-d97dcfb2ae61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:21.492858 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cedc5a-1122-477b-a55d-d97dcfb2ae61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:21.495064 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cedc5a-1122-477b-a55d-d97dcfb2ae61 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:21.502680 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 224/449] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:21.508935 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cedc5a-1122-477b-a55d-d97dcfb2ae61 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:21.541788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b7a2-fa7c-4506-829a-282cc7a5bf27 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:21.582917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2882d2e-2091-433d-85bf-de81657d5a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:21.583541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2882d2e-2091-433d-85bf-de81657d5a59 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:21.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2882d2e-2091-433d-85bf-de81657d5a59 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:21.584081 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2882d2e-2091-433d-85bf-de81657d5a59 None admin] PATH_INFO: `/v3/groups/84bd616231bd4e5aa7f7a586dde9251b` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:21.585208 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2882d2e-2091-433d-85bf-de81657d5a59 None admin] RBAC: Authorizing `identity:get_group(group_id=84bd616231bd4e5aa7f7a586dde9251b)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:21.587307 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2882d2e-2091-433d-85bf-de81657d5a59 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:21.589057 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 226/450] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:21 2022] GET /identity/v3/groups/84bd616231bd4e5aa7f7a586dde9251b => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:21.594901 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2882d2e-2091-433d-85bf-de81657d5a59 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:21.632842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cedc5a-1122-477b-a55d-d97dcfb2ae61 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:21.668435 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:21.671187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd84e9a-541c-442d-ae47-cce8f1872e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:21.671785 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd84e9a-541c-442d-ae47-cce8f1872e9b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:21.672065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd84e9a-541c-442d-ae47-cce8f1872e9b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:21.672341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd84e9a-541c-442d-ae47-cce8f1872e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:21.724766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2882d2e-2091-433d-85bf-de81657d5a59 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:21.737790 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:21.749597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd84e9a-541c-442d-ae47-cce8f1872e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:21.751105 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd84e9a-541c-442d-ae47-cce8f1872e9b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:21.762365 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c21364-662f-4d75-8731-0c86cb1a61bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:21.762965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c21364-662f-4d75-8731-0c86cb1a61bf None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:21.763238 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c21364-662f-4d75-8731-0c86cb1a61bf None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:21.763508 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c21364-662f-4d75-8731-0c86cb1a61bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:21.764221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c21364-662f-4d75-8731-0c86cb1a61bf None admin] RBAC: Adding query filter params (group.id=84bd616231bd4e5aa7f7a586dde9251b, role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=a1449954a4a84885b4be97fe68c1c864) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:21.764525 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c21364-662f-4d75-8731-0c86cb1a61bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:21.765974 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c21364-662f-4d75-8731-0c86cb1a61bf None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:21.771552 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 227/451] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:21 2022] GET /identity/v3/role_assignments?group.id=84bd616231bd4e5aa7f7a586dde9251b&scope.project.id=a1449954a4a84885b4be97fe68c1c864&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:21.864033 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 225/452] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 20:38:21.871161 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c21364-662f-4d75-8731-0c86cb1a61bf None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:21.975000 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c21364-662f-4d75-8731-0c86cb1a61bf None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:22.004414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:22.025798 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0861e7-802f-4799-bcfa-919d67611671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:22.026491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0861e7-802f-4799-bcfa-919d67611671 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:22.026771 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0861e7-802f-4799-bcfa-919d67611671 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:22.027041 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0861e7-802f-4799-bcfa-919d67611671 None admin] PATH_INFO: `/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:22.028227 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0861e7-802f-4799-bcfa-919d67611671 None admin] RBAC: Authorizing `identity:get_project(project_id=72850c3bcfc74a83ab924bd3fd1748ad)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:22.029722 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0861e7-802f-4799-bcfa-919d67611671 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:22.031357 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 228/453] 10.222.0.52 () {56 vars in 1186 bytes} [Sat Sep 17 20:38:21 2022] GET /identity/v3/projects/72850c3bcfc74a83ab924bd3fd1748ad => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:22.037270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd84e9a-541c-442d-ae47-cce8f1872e9b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:22.123088 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:22.134614 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd84e9a-541c-442d-ae47-cce8f1872e9b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:22.168194 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b45ee-d96e-439f-a03a-2d79b9542049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:22.168804 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b45ee-d96e-439f-a03a-2d79b9542049 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:22.169082 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b45ee-d96e-439f-a03a-2d79b9542049 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:22.169386 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b45ee-d96e-439f-a03a-2d79b9542049 None admin] PATH_INFO: `/v3/groups/0a5a6b98827148c286a577087cee9fbe` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:22.170483 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b45ee-d96e-439f-a03a-2d79b9542049 None admin] RBAC: Authorizing `identity:get_group(group_id=0a5a6b98827148c286a577087cee9fbe)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:22.171917 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b45ee-d96e-439f-a03a-2d79b9542049 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:22.173502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 226/454] 10.222.0.52 () {56 vars in 1180 bytes} [Sat Sep 17 20:38:22 2022] GET /identity/v3/groups/0a5a6b98827148c286a577087cee9fbe => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:22.179534 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0861e7-802f-4799-bcfa-919d67611671 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:22.276786 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0861e7-802f-4799-bcfa-919d67611671 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:22.307873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fada62-46f0-40ff-b499-d0a8bc9f698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:22.308453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fada62-46f0-40ff-b499-d0a8bc9f698f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:22.308731 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fada62-46f0-40ff-b499-d0a8bc9f698f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:22.309002 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fada62-46f0-40ff-b499-d0a8bc9f698f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:22.309738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fada62-46f0-40ff-b499-d0a8bc9f698f None admin] RBAC: Adding query filter params (group.id=0a5a6b98827148c286a577087cee9fbe, role.id=1245a77a23c14542b165310facdab5cd, scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:22.310045 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fada62-46f0-40ff-b499-d0a8bc9f698f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:22.311472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fada62-46f0-40ff-b499-d0a8bc9f698f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:22.316912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 229/455] 10.222.0.52 () {56 vars in 1376 bytes} [Sat Sep 17 20:38:22 2022] GET /identity/v3/role_assignments?group.id=0a5a6b98827148c286a577087cee9fbe&scope.project.id=72850c3bcfc74a83ab924bd3fd1748ad&role.id=1245a77a23c14542b165310facdab5cd => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:25.213259 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65510ca-9102-4fc8-be55-94d73ef0103e None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:25.215882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65510ca-9102-4fc8-be55-94d73ef0103e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:25.215882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65510ca-9102-4fc8-be55-94d73ef0103e None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:25.216356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 227/456] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:25.222329 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871a4e1-07ae-4aa4-8a0b-972e77b12ba3 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:25.223115 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871a4e1-07ae-4aa4-8a0b-972e77b12ba3 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:25.223601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871a4e1-07ae-4aa4-8a0b-972e77b12ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:25.242724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-f871a4e1-07ae-4aa4-8a0b-972e77b12ba3 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:25.244211 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-f871a4e1-07ae-4aa4-8a0b-972e77b12ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:25.296189 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:25.318120 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 230/457] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:25.415380 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5865fef-02aa-4db1-abae-fbc03a8509ec None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:25.416041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5865fef-02aa-4db1-abae-fbc03a8509ec None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:25.416524 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5865fef-02aa-4db1-abae-fbc03a8509ec None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:25.418503 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 228/458] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:25.424127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444b8d1-3a94-460e-a547-35573d45cb7a None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:25.424744 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444b8d1-3a94-460e-a547-35573d45cb7a None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:25.425300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444b8d1-3a94-460e-a547-35573d45cb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:25.444300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-a444b8d1-3a94-460e-a547-35573d45cb7a None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:25.446373 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-a444b8d1-3a94-460e-a547-35573d45cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:25.518652 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 231/459] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:25.577305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bd42d-8c7e-4f30-97c4-4d09d70eb0d8 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:25.577629 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bd42d-8c7e-4f30-97c4-4d09d70eb0d8 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:25.577852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bd42d-8c7e-4f30-97c4-4d09d70eb0d8 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:25.579175 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 229/460] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:25.584353 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b937d8-d655-4510-ab12-e1c87c5df221 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:25.584641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b937d8-d655-4510-ab12-e1c87c5df221 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:25.584914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b937d8-d655-4510-ab12-e1c87c5df221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:25.604149 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-33b937d8-d655-4510-ab12-e1c87c5df221 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:25.605356 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-33b937d8-d655-4510-ab12-e1c87c5df221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:25.660200 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bd42d-8c7e-4f30-97c4-4d09d70eb0d8 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:25.681768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 232/461] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:25.774721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bd42d-8c7e-4f30-97c4-4d09d70eb0d8 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:25.809137 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcead8c-bed9-4ac3-8633-b758df9babb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:25.809790 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcead8c-bed9-4ac3-8633-b758df9babb9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:25.810063 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcead8c-bed9-4ac3-8633-b758df9babb9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:25.810332 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcead8c-bed9-4ac3-8633-b758df9babb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:25.821617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcead8c-bed9-4ac3-8633-b758df9babb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:25.823089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcead8c-bed9-4ac3-8633-b758df9babb9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-7dcead8c-bed9-4ac3-8633-b758df9babb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:25.838840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:25.839762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:25.840735 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:25.840735 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:25.840735 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:25.840735 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 230/462] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:25.850239 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b937d8-d655-4510-ab12-e1c87c5df221 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:25.869914 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56828e3-1bee-48c8-a122-8ec649f030dd None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:25.870239 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56828e3-1bee-48c8-a122-8ec649f030dd None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:25.870466 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56828e3-1bee-48c8-a122-8ec649f030dd None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:25.873058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 231/463] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:25.877185 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5348b1-915c-42e7-8dcf-07dc51a7ef84 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:25.877493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5348b1-915c-42e7-8dcf-07dc51a7ef84 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:25.877765 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5348b1-915c-42e7-8dcf-07dc51a7ef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:25.898135 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:25.900588 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-6b5348b1-915c-42e7-8dcf-07dc51a7ef84 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:25.902423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-6b5348b1-915c-42e7-8dcf-07dc51a7ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:25.904800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:25.957930 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b937d8-d655-4510-ab12-e1c87c5df221 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:25.974810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 232/464] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:25.975776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5348b1-915c-42e7-8dcf-07dc51a7ef84 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:26.005320 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60123de4-be40-4272-bd54-c1f05ccca885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.007021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60123de4-be40-4272-bd54-c1f05ccca885 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.011667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60123de4-be40-4272-bd54-c1f05ccca885 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.011667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60123de4-be40-4272-bd54-c1f05ccca885 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.011667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60123de4-be40-4272-bd54-c1f05ccca885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:26.011667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60123de4-be40-4272-bd54-c1f05ccca885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.011667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60123de4-be40-4272-bd54-c1f05ccca885 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.034066 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 233/465] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:26.035192 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60123de4-be40-4272-bd54-c1f05ccca885 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:26.100789 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5348b1-915c-42e7-8dcf-07dc51a7ef84 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:26.136776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b6427-6a9c-4fcf-9220-f0868a9cb364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.137420 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6427-6a9c-4fcf-9220-f0868a9cb364 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.137686 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6427-6a9c-4fcf-9220-f0868a9cb364 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.137953 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6427-6a9c-4fcf-9220-f0868a9cb364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.144853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:26.146208 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60123de4-be40-4272-bd54-c1f05ccca885 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:26.149049 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b6427-6a9c-4fcf-9220-f0868a9cb364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.150206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:26.150541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b6427-6a9c-4fcf-9220-f0868a9cb364 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-cb7b6427-6a9c-4fcf-9220-f0868a9cb364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:26.164721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:26.165719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:26.166606 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:26.166606 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:26.166606 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:26.166606 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 233/466] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:26.166606 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b6427-6a9c-4fcf-9220-f0868a9cb364 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:26.190064 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466802e8-a2e8-44d6-8c41-d1bc5f35eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.191043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466802e8-a2e8-44d6-8c41-d1bc5f35eb00 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.191043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466802e8-a2e8-44d6-8c41-d1bc5f35eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.191233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466802e8-a2e8-44d6-8c41-d1bc5f35eb00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.201922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466802e8-a2e8-44d6-8c41-d1bc5f35eb00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.204195 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466802e8-a2e8-44d6-8c41-d1bc5f35eb00 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-466802e8-a2e8-44d6-8c41-d1bc5f35eb00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:26.221562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:26.222882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:26.223723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:26.223723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:26.223723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:26.223723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 234/467] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:26.223723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466802e8-a2e8-44d6-8c41-d1bc5f35eb00 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:26.283047 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b6427-6a9c-4fcf-9220-f0868a9cb364 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:26.319253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b23ab-d4d3-477d-836a-4cc062b3568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.319769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b23ab-d4d3-477d-836a-4cc062b3568b None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.320041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b23ab-d4d3-477d-836a-4cc062b3568b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.321063 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b23ab-d4d3-477d-836a-4cc062b3568b None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.321733 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b23ab-d4d3-477d-836a-4cc062b3568b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.323151 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b23ab-d4d3-477d-836a-4cc062b3568b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.326843 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466802e8-a2e8-44d6-8c41-d1bc5f35eb00 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:26.359970 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ef7a-2146-46b1-ac1b-2680bf13c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.360569 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ef7a-2146-46b1-ac1b-2680bf13c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.360902 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ef7a-2146-46b1-ac1b-2680bf13c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.361202 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ef7a-2146-46b1-ac1b-2680bf13c5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.361841 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992ef7a-2146-46b1-ac1b-2680bf13c5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:26.362151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992ef7a-2146-46b1-ac1b-2680bf13c5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.363527 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992ef7a-2146-46b1-ac1b-2680bf13c5a9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.375384 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 235/468] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:26.376170 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ef7a-2146-46b1-ac1b-2680bf13c5a9 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:26.393830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:26.470679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ef7a-2146-46b1-ac1b-2680bf13c5a9 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:26.474805 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 234/469] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:38:26 2022] POST /identity/v3/users => generated 246 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:38:26.475675 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b23ab-d4d3-477d-836a-4cc062b3568b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:26.508587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565ac3d-5ee6-417f-95cf-7f7f57cc9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.509235 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565ac3d-5ee6-417f-95cf-7f7f57cc9c1f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.509531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565ac3d-5ee6-417f-95cf-7f7f57cc9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.509788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565ac3d-5ee6-417f-95cf-7f7f57cc9c1f None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.510547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565ac3d-5ee6-417f-95cf-7f7f57cc9c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:26.510847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565ac3d-5ee6-417f-95cf-7f7f57cc9c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.512322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565ac3d-5ee6-417f-95cf-7f7f57cc9c1f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.529707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 236/470] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:26.529707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565ac3d-5ee6-417f-95cf-7f7f57cc9c1f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:26.558098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:26.621436 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:26.621878 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b23ab-d4d3-477d-836a-4cc062b3568b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:26.645514 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565ac3d-5ee6-417f-95cf-7f7f57cc9c1f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:26.662224 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30e764-02a5-4fd5-8e1d-72a3d6b53a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.662865 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30e764-02a5-4fd5-8e1d-72a3d6b53a23 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.663143 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30e764-02a5-4fd5-8e1d-72a3d6b53a23 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.663413 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30e764-02a5-4fd5-8e1d-72a3d6b53a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.680782 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30e764-02a5-4fd5-8e1d-72a3d6b53a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.682301 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30e764-02a5-4fd5-8e1d-72a3d6b53a23 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.687098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173c182-be7b-47b8-a286-5adf241e8e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.687954 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173c182-be7b-47b8-a286-5adf241e8e5a None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.688424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173c182-be7b-47b8-a286-5adf241e8e5a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.688761 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173c182-be7b-47b8-a286-5adf241e8e5a None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.689510 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173c182-be7b-47b8-a286-5adf241e8e5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.691032 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173c182-be7b-47b8-a286-5adf241e8e5a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-3c30e764-02a5-4fd5-8e1d-72a3d6b53a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:26.703892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:26.704980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:26.706068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:26.706068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:26.706068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:26.708997 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 235/471] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:26.708997 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30e764-02a5-4fd5-8e1d-72a3d6b53a23 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:26.767348 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 237/472] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:38:26 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:38:26.768344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173c182-be7b-47b8-a286-5adf241e8e5a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:26.833568 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:26.838300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30e764-02a5-4fd5-8e1d-72a3d6b53a23 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:26.887303 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99713668-23cc-48cb-9928-4e734b027936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.888140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713668-23cc-48cb-9928-4e734b027936 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.888544 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713668-23cc-48cb-9928-4e734b027936 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.888827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713668-23cc-48cb-9928-4e734b027936 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.889532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99713668-23cc-48cb-9928-4e734b027936 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.891545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99713668-23cc-48cb-9928-4e734b027936 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.908892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173c182-be7b-47b8-a286-5adf241e8e5a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:26.944231 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:26.950392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13902f-0833-4ed7-aa82-6b29d358091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:26.951098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13902f-0833-4ed7-aa82-6b29d358091b None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:26.951446 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13902f-0833-4ed7-aa82-6b29d358091b None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:26.951791 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13902f-0833-4ed7-aa82-6b29d358091b None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:26.952548 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13902f-0833-4ed7-aa82-6b29d358091b None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:26.952938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13902f-0833-4ed7-aa82-6b29d358091b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:26.954487 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13902f-0833-4ed7-aa82-6b29d358091b None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:26.969057 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 238/473] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:26.977134 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13902f-0833-4ed7-aa82-6b29d358091b None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:27.007532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 236/474] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:38:26 2022] POST /identity/v3/users => generated 248 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:38:27.106811 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13902f-0833-4ed7-aa82-6b29d358091b None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:27.146690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d73368-4b5c-467b-9d08-aa082aff49b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:27.147304 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73368-4b5c-467b-9d08-aa082aff49b1 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:27.147583 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73368-4b5c-467b-9d08-aa082aff49b1 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:27.147852 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73368-4b5c-467b-9d08-aa082aff49b1 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:27.149035 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d73368-4b5c-467b-9d08-aa082aff49b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:27.150961 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d73368-4b5c-467b-9d08-aa082aff49b1 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:27.237435 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 239/475] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:38:26 2022] POST /identity/v3/users => generated 249 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:38:29.027193 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c925d-394b-41a3-a2d5-f7e9a3bf9b01 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.028187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c925d-394b-41a3-a2d5-f7e9a3bf9b01 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.028666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c925d-394b-41a3-a2d5-f7e9a3bf9b01 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.030595 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 237/476] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:29.036115 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc9259-3f99-4f40-809f-4fab69c21440 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.036919 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc9259-3f99-4f40-809f-4fab69c21440 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.037419 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc9259-3f99-4f40-809f-4fab69c21440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.056516 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-6ebc9259-3f99-4f40-809f-4fab69c21440 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:29.058086 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-6ebc9259-3f99-4f40-809f-4fab69c21440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:29.105860 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:29.132620 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 240/477] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:29.450058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07645d-1b3c-4c12-a501-070f89c5e026 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.450453 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07645d-1b3c-4c12-a501-070f89c5e026 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.450726 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07645d-1b3c-4c12-a501-070f89c5e026 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.452426 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 238/478] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:29.457858 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3894-3f50-453e-9401-9e171c0c1d79 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.458143 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3894-3f50-453e-9401-9e171c0c1d79 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.458434 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3894-3f50-453e-9401-9e171c0c1d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.462872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07645d-1b3c-4c12-a501-070f89c5e026 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:29.478628 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-306e3894-3f50-453e-9401-9e171c0c1d79 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:29.479858 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-306e3894-3f50-453e-9401-9e171c0c1d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:29.573294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07645d-1b3c-4c12-a501-070f89c5e026 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:29.576339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 241/479] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:29.577230 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133edf-ed0a-42e7-80eb-191714a77e77 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.577517 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133edf-ed0a-42e7-80eb-191714a77e77 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.577787 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133edf-ed0a-42e7-80eb-191714a77e77 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.579208 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 242/480] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:29.585676 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982b43-ec57-4682-83a7-c9bf9f58a5e3 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.585676 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982b43-ec57-4682-83a7-c9bf9f58a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.585676 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982b43-ec57-4682-83a7-c9bf9f58a5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.603435 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-49982b43-ec57-4682-83a7-c9bf9f58a5e3 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:29.604589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-49982b43-ec57-4682-83a7-c9bf9f58a5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:29.614753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7750b07-07c5-42c3-b7df-017b0bc98af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:29.615603 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7750b07-07c5-42c3-b7df-017b0bc98af4 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.620732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7750b07-07c5-42c3-b7df-017b0bc98af4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.620732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7750b07-07c5-42c3-b7df-017b0bc98af4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.627871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7750b07-07c5-42c3-b7df-017b0bc98af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-f7750b07-07c5-42c3-b7df-017b0bc98af4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:29.633825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:29.634795 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:29.635579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 239/481] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:29.640672 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7750b07-07c5-42c3-b7df-017b0bc98af4 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:29.661044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:29.705389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 243/482] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:29.767295 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7750b07-07c5-42c3-b7df-017b0bc98af4 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:29.768263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5bab-34f5-431b-9505-d32e08ce97e7 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.768547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5bab-34f5-431b-9505-d32e08ce97e7 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.768821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5bab-34f5-431b-9505-d32e08ce97e7 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.770432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 244/483] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:29.775377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52f38-8505-4e9f-a026-21be590ccf33 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.775655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52f38-8505-4e9f-a026-21be590ccf33 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.775922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52f38-8505-4e9f-a026-21be590ccf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.794503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-f8c52f38-8505-4e9f-a026-21be590ccf33 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:29.795674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-f8c52f38-8505-4e9f-a026-21be590ccf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:29.826384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aa838-1804-405f-a33d-fc31cabb845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:29.826992 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aa838-1804-405f-a33d-fc31cabb845a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:29.827272 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aa838-1804-405f-a33d-fc31cabb845a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:29.827541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aa838-1804-405f-a33d-fc31cabb845a None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:29.828205 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724aa838-1804-405f-a33d-fc31cabb845a None admin] RBAC: Adding query filter params (name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:29.828505 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724aa838-1804-405f-a33d-fc31cabb845a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:29.829956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724aa838-1804-405f-a33d-fc31cabb845a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:29.838276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:29.839057 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 240/484] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:29.844186 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aa838-1804-405f-a33d-fc31cabb845a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:29.892519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 245/485] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:29.921491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c52f38-8505-4e9f-a026-21be590ccf33 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:29.948389 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:29.978226 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aa838-1804-405f-a33d-fc31cabb845a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.014763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c406c32-6ff4-4fed-8f1b-8518918e29c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.015386 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406c32-6ff4-4fed-8f1b-8518918e29c6 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.015667 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406c32-6ff4-4fed-8f1b-8518918e29c6 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.015942 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406c32-6ff4-4fed-8f1b-8518918e29c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.025558 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c52f38-8505-4e9f-a026-21be590ccf33 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.027219 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c406c32-6ff4-4fed-8f1b-8518918e29c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.028672 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c406c32-6ff4-4fed-8f1b-8518918e29c6 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-2c406c32-6ff4-4fed-8f1b-8518918e29c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:30.044141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:30.045042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:30.045922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:30.045922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:30.045922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:30.045922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 241/486] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:30.051021 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c406c32-6ff4-4fed-8f1b-8518918e29c6 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.062885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaad921-cfbc-4fed-addc-6bcc008870b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.063525 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaad921-cfbc-4fed-addc-6bcc008870b7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.063784 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaad921-cfbc-4fed-addc-6bcc008870b7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.064058 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaad921-cfbc-4fed-addc-6bcc008870b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.075852 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaad921-cfbc-4fed-addc-6bcc008870b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-efaad921-cfbc-4fed-addc-6bcc008870b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:30.080630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:30.081641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:30.082432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 246/487] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:30.086673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaad921-cfbc-4fed-addc-6bcc008870b7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.116982 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:30.160033 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c406c32-6ff4-4fed-8f1b-8518918e29c6 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.186325 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:30.194594 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb5991-df25-4731-95a5-e4d731fc1370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.195233 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb5991-df25-4731-95a5-e4d731fc1370 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.195506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb5991-df25-4731-95a5-e4d731fc1370 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.195778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb5991-df25-4731-95a5-e4d731fc1370 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.196096 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaad921-cfbc-4fed-addc-6bcc008870b7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.201395 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb5991-df25-4731-95a5-e4d731fc1370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:30.201395 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb5991-df25-4731-95a5-e4d731fc1370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.201395 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb5991-df25-4731-95a5-e4d731fc1370 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.210206 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 242/488] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:30.211357 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb5991-df25-4731-95a5-e4d731fc1370 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.238400 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410e71-e3b9-4d09-91d9-d95f9d156e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.238937 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410e71-e3b9-4d09-91d9-d95f9d156e45 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.239222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410e71-e3b9-4d09-91d9-d95f9d156e45 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.239614 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410e71-e3b9-4d09-91d9-d95f9d156e45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.250293 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82410e71-e3b9-4d09-91d9-d95f9d156e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-82410e71-e3b9-4d09-91d9-d95f9d156e45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:30.255117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:30.256116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:30.256905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 247/489] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:30.257601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410e71-e3b9-4d09-91d9-d95f9d156e45 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.316893 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb5991-df25-4731-95a5-e4d731fc1370 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.344865 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:30.351604 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6574f-0593-4675-a099-06fd24e4b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.352283 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6574f-0593-4675-a099-06fd24e4b036 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.352559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6574f-0593-4675-a099-06fd24e4b036 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.352829 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6574f-0593-4675-a099-06fd24e4b036 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.355545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6574f-0593-4675-a099-06fd24e4b036 None admin] RBAC: Adding query filter params (name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:30.355545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6574f-0593-4675-a099-06fd24e4b036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.355545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6574f-0593-4675-a099-06fd24e4b036 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.356702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410e71-e3b9-4d09-91d9-d95f9d156e45 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.362891 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 243/490] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:30.363666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6574f-0593-4675-a099-06fd24e4b036 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.392822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274cc1b-d4bc-4129-8f09-ddd9e112c9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.393471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274cc1b-d4bc-4129-8f09-ddd9e112c9e2 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.393751 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274cc1b-d4bc-4129-8f09-ddd9e112c9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.394018 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274cc1b-d4bc-4129-8f09-ddd9e112c9e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.401344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274cc1b-d4bc-4129-8f09-ddd9e112c9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.402773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274cc1b-d4bc-4129-8f09-ddd9e112c9e2 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.412933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-d274cc1b-d4bc-4129-8f09-ddd9e112c9e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:30.415702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:30.416594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:30.417524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 248/491] 10.222.0.52 () {56 vars in 1093 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:30.418088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274cc1b-d4bc-4129-8f09-ddd9e112c9e2 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.467667 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6574f-0593-4675-a099-06fd24e4b036 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.500397 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0c5f9-51e8-41d2-9c68-04616a914f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.500938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0c5f9-51e8-41d2-9c68-04616a914f52 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.501242 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0c5f9-51e8-41d2-9c68-04616a914f52 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.501516 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0c5f9-51e8-41d2-9c68-04616a914f52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.511991 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0c5f9-51e8-41d2-9c68-04616a914f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:30.513920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274cc1b-d4bc-4129-8f09-ddd9e112c9e2 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-1eb0c5f9-51e8-41d2-9c68-04616a914f52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:30.517155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:30.518066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:30.518852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 244/492] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:30.519490 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0c5f9-51e8-41d2-9c68-04616a914f52 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.549759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8674d47-9b06-47ba-8ca3-b5009cc50533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.550354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8674d47-9b06-47ba-8ca3-b5009cc50533 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.550632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8674d47-9b06-47ba-8ca3-b5009cc50533 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.550903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8674d47-9b06-47ba-8ca3-b5009cc50533 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.551554 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8674d47-9b06-47ba-8ca3-b5009cc50533 None admin] RBAC: Adding query filter params (name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:30.551852 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8674d47-9b06-47ba-8ca3-b5009cc50533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.553259 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8674d47-9b06-47ba-8ca3-b5009cc50533 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.561540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 249/493] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:30.562314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8674d47-9b06-47ba-8ca3-b5009cc50533 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.574930 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:30.623613 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0c5f9-51e8-41d2-9c68-04616a914f52 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.634206 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:30.656950 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8450b-c511-4feb-b9f8-8c8b1576684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.657598 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8450b-c511-4feb-b9f8-8c8b1576684c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.657893 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8450b-c511-4feb-b9f8-8c8b1576684c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.658160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8450b-c511-4feb-b9f8-8c8b1576684c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.662038 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8674d47-9b06-47ba-8ca3-b5009cc50533 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.668712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8450b-c511-4feb-b9f8-8c8b1576684c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.670199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8450b-c511-4feb-b9f8-8c8b1576684c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-b3e8450b-c511-4feb-b9f8-8c8b1576684c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:30.684323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:30.685363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:30.686199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:30.686199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:30.686199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:30.686199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 245/494] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:30.686199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8450b-c511-4feb-b9f8-8c8b1576684c None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.701621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6277b1-41a6-4a41-b013-54b98f919da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.702230 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6277b1-41a6-4a41-b013-54b98f919da5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.702507 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6277b1-41a6-4a41-b013-54b98f919da5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.702778 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6277b1-41a6-4a41-b013-54b98f919da5 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.703505 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6277b1-41a6-4a41-b013-54b98f919da5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:30.703813 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6277b1-41a6-4a41-b013-54b98f919da5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.705271 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6277b1-41a6-4a41-b013-54b98f919da5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.743699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 250/495] 10.222.0.52 () {56 vars in 1133 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:30.744542 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6277b1-41a6-4a41-b013-54b98f919da5 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.792355 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8450b-c511-4feb-b9f8-8c8b1576684c None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.811189 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:30.826525 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b233036-7677-4426-bc6d-e945abf782d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.827117 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233036-7677-4426-bc6d-e945abf782d4 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.827427 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233036-7677-4426-bc6d-e945abf782d4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.827696 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233036-7677-4426-bc6d-e945abf782d4 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.828358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b233036-7677-4426-bc6d-e945abf782d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:30.828640 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b233036-7677-4426-bc6d-e945abf782d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.830040 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b233036-7677-4426-bc6d-e945abf782d4 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.837753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 246/496] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:30.838517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b233036-7677-4426-bc6d-e945abf782d4 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.845989 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6277b1-41a6-4a41-b013-54b98f919da5 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.863372 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:30.879846 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6bd07-9ecd-4f02-aaea-6f89d5e5cce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.880475 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6bd07-9ecd-4f02-aaea-6f89d5e5cce5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.880757 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6bd07-9ecd-4f02-aaea-6f89d5e5cce5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.881030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6bd07-9ecd-4f02-aaea-6f89d5e5cce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.891770 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6bd07-9ecd-4f02-aaea-6f89d5e5cce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.893255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6bd07-9ecd-4f02-aaea-6f89d5e5cce5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-f9c6bd07-9ecd-4f02-aaea-6f89d5e5cce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:30.907477 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:30.908368 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:30.909598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:30.909598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:30.909598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:30.909598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 251/497] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:30.909598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6bd07-9ecd-4f02-aaea-6f89d5e5cce5 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:30.938112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b233036-7677-4426-bc6d-e945abf782d4 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:30.971784 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4705-a568-4725-b260-b369c35eb693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:30.972398 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4705-a568-4725-b260-b369c35eb693 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:30.972688 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4705-a568-4725-b260-b369c35eb693 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:30.972951 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4705-a568-4725-b260-b369c35eb693 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:30.973609 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f4705-a568-4725-b260-b369c35eb693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:30.973910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f4705-a568-4725-b260-b369c35eb693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:30.975297 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f4705-a568-4725-b260-b369c35eb693 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:30.988404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 247/498] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:30.989237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4705-a568-4725-b260-b369c35eb693 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.008407 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6bd07-9ecd-4f02-aaea-6f89d5e5cce5 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.028221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.043236 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8785cd0-fcf0-4425-b54f-8f63937dbac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.043771 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8785cd0-fcf0-4425-b54f-8f63937dbac5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.044049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8785cd0-fcf0-4425-b54f-8f63937dbac5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.044319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8785cd0-fcf0-4425-b54f-8f63937dbac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.076887 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.092359 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4705-a568-4725-b260-b369c35eb693 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.112692 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8785cd0-fcf0-4425-b54f-8f63937dbac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.114185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8785cd0-fcf0-4425-b54f-8f63937dbac5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.126784 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc4908-33b8-491c-9759-46af52e2b9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.127480 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc4908-33b8-491c-9759-46af52e2b9b9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.127823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc4908-33b8-491c-9759-46af52e2b9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.128160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc4908-33b8-491c-9759-46af52e2b9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.138858 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc4908-33b8-491c-9759-46af52e2b9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.140300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc4908-33b8-491c-9759-46af52e2b9b9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-77bc4908-33b8-491c-9759-46af52e2b9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:31.155447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:31.156514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:31.157673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:31.157673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:31.157673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:31.157673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 248/499] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:31.157673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc4908-33b8-491c-9759-46af52e2b9b9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.215267 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 252/500] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:31.216118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8785cd0-fcf0-4425-b54f-8f63937dbac5 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.239864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.254851 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc4908-33b8-491c-9759-46af52e2b9b9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.290441 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a64220-51f6-441f-8ed7-80124ffcd17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.291032 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a64220-51f6-441f-8ed7-80124ffcd17f None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.291303 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a64220-51f6-441f-8ed7-80124ffcd17f None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.291569 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a64220-51f6-441f-8ed7-80124ffcd17f None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.292189 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a64220-51f6-441f-8ed7-80124ffcd17f None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:31.292485 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a64220-51f6-441f-8ed7-80124ffcd17f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.293924 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a64220-51f6-441f-8ed7-80124ffcd17f None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.296113 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.305832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 249/501] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:31.306678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a64220-51f6-441f-8ed7-80124ffcd17f None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.322970 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8785cd0-fcf0-4425-b54f-8f63937dbac5 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.356144 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5d367-2823-4915-b401-0e12efa52431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.356765 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d367-2823-4915-b401-0e12efa52431 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.357044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d367-2823-4915-b401-0e12efa52431 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.357351 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d367-2823-4915-b401-0e12efa52431 None admin] PATH_INFO: `/v3/users/glance` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.364053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5d367-2823-4915-b401-0e12efa52431 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.365526 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5d367-2823-4915-b401-0e12efa52431 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-33e5d367-2823-4915-b401-0e12efa52431 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:31.377714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:31.378760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 253/502] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:31.379840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5d367-2823-4915-b401-0e12efa52431 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.407173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a64220-51f6-441f-8ed7-80124ffcd17f None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.440498 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344897e1-f831-4037-8aee-e462e74181b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.441093 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344897e1-f831-4037-8aee-e462e74181b8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.441418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344897e1-f831-4037-8aee-e462e74181b8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.441690 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344897e1-f831-4037-8aee-e462e74181b8 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.442323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344897e1-f831-4037-8aee-e462e74181b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:31.442887 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344897e1-f831-4037-8aee-e462e74181b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.444246 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344897e1-f831-4037-8aee-e462e74181b8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.456099 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 250/503] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:31.456898 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344897e1-f831-4037-8aee-e462e74181b8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.463810 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.481497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5d367-2823-4915-b401-0e12efa52431 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.512987 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.515496 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e67d9a-a103-433e-9334-4c656e48e933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.516125 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e67d9a-a103-433e-9334-4c656e48e933 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.516403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e67d9a-a103-433e-9334-4c656e48e933 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.516686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e67d9a-a103-433e-9334-4c656e48e933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.527451 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e67d9a-a103-433e-9334-4c656e48e933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.528917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e67d9a-a103-433e-9334-4c656e48e933 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-f7e67d9a-a103-433e-9334-4c656e48e933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:31.543577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:31.544674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:31.545708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:31.545708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:31.545708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:31.545708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 254/504] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:31.545963 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e67d9a-a103-433e-9334-4c656e48e933 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.559014 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344897e1-f831-4037-8aee-e462e74181b8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.592662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6629f-9eba-452c-ad9f-6b97d52b4f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.593311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6629f-9eba-452c-ad9f-6b97d52b4f53 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.593592 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6629f-9eba-452c-ad9f-6b97d52b4f53 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.593866 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6629f-9eba-452c-ad9f-6b97d52b4f53 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.601891 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6629f-9eba-452c-ad9f-6b97d52b4f53 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.603466 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6629f-9eba-452c-ad9f-6b97d52b4f53 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-78a6629f-9eba-452c-ad9f-6b97d52b4f53 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:31.615509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:31.616570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:31.617821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 251/505] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:31.618368 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6629f-9eba-452c-ad9f-6b97d52b4f53 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.652440 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e67d9a-a103-433e-9334-4c656e48e933 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.680359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.684913 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764638c-6f59-41af-baf8-f0a4c52079bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.685545 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764638c-6f59-41af-baf8-f0a4c52079bf None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.685822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764638c-6f59-41af-baf8-f0a4c52079bf None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.686094 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764638c-6f59-41af-baf8-f0a4c52079bf None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.686865 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764638c-6f59-41af-baf8-f0a4c52079bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:31.687178 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764638c-6f59-41af-baf8-f0a4c52079bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.688607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764638c-6f59-41af-baf8-f0a4c52079bf None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.705372 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 255/506] 10.222.0.52 () {56 vars in 1137 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:31.706333 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764638c-6f59-41af-baf8-f0a4c52079bf None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.719752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6629f-9eba-452c-ad9f-6b97d52b4f53 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.735361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.752880 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41451-82cb-4a6a-b213-936c8d0be662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.753532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41451-82cb-4a6a-b213-936c8d0be662 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.753809 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41451-82cb-4a6a-b213-936c8d0be662 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.754081 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41451-82cb-4a6a-b213-936c8d0be662 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.762055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b41451-82cb-4a6a-b213-936c8d0be662 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.763493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b41451-82cb-4a6a-b213-936c8d0be662 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-34b41451-82cb-4a6a-b213-936c8d0be662 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:31.775236 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:31.776267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 252/507] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:31.777187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41451-82cb-4a6a-b213-936c8d0be662 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.810352 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764638c-6f59-41af-baf8-f0a4c52079bf None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.844213 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae058363-0800-4040-9fd6-2441f533a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.844894 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae058363-0800-4040-9fd6-2441f533a39c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.845267 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae058363-0800-4040-9fd6-2441f533a39c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.845603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae058363-0800-4040-9fd6-2441f533a39c None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.846303 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae058363-0800-4040-9fd6-2441f533a39c None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:31.846687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae058363-0800-4040-9fd6-2441f533a39c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.848156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae058363-0800-4040-9fd6-2441f533a39c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.859316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 256/508] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:31.859316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae058363-0800-4040-9fd6-2441f533a39c None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.879572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41451-82cb-4a6a-b213-936c8d0be662 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.908783 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.912554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbbfbf-195d-427d-919f-e35893da5b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.913148 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbbfbf-195d-427d-919f-e35893da5b34 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.913456 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbbfbf-195d-427d-919f-e35893da5b34 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.913732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbbfbf-195d-427d-919f-e35893da5b34 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:31.914545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbbfbf-195d-427d-919f-e35893da5b34 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:31.914851 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbbfbf-195d-427d-919f-e35893da5b34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:31.916904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbbfbf-195d-427d-919f-e35893da5b34 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:31.953070 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 253/509] 10.222.0.52 () {56 vars in 1137 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:31.953917 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbbfbf-195d-427d-919f-e35893da5b34 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:31.962729 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae058363-0800-4040-9fd6-2441f533a39c None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:31.986807 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:31.997457 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22df6d8-f82b-4961-a648-d10786c46051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:31.998056 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22df6d8-f82b-4961-a648-d10786c46051 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:31.998333 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22df6d8-f82b-4961-a648-d10786c46051 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:31.998601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22df6d8-f82b-4961-a648-d10786c46051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.052466 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbbfbf-195d-427d-919f-e35893da5b34 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:32.065623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22df6d8-f82b-4961-a648-d10786c46051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.067113 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22df6d8-f82b-4961-a648-d10786c46051 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.086216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00258e6-0758-4ba7-8425-0a8c85606ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:32.086810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00258e6-0758-4ba7-8425-0a8c85606ca8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:32.087085 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00258e6-0758-4ba7-8425-0a8c85606ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:32.087362 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00258e6-0758-4ba7-8425-0a8c85606ca8 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.088069 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00258e6-0758-4ba7-8425-0a8c85606ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:32.088369 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00258e6-0758-4ba7-8425-0a8c85606ca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.089825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00258e6-0758-4ba7-8425-0a8c85606ca8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.106700 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 254/510] 10.222.0.52 () {56 vars in 1139 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:32.106700 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00258e6-0758-4ba7-8425-0a8c85606ca8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.120430 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:32.172269 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 257/511] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:32.173535 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22df6d8-f82b-4961-a648-d10786c46051 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.208291 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:32.218017 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00258e6-0758-4ba7-8425-0a8c85606ca8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:32.252286 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59e627-e79b-417e-9066-586436d17d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:32.252903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59e627-e79b-417e-9066-586436d17d42 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:32.253201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59e627-e79b-417e-9066-586436d17d42 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:32.253477 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59e627-e79b-417e-9066-586436d17d42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.260638 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59e627-e79b-417e-9066-586436d17d42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.262105 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59e627-e79b-417e-9066-586436d17d42 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-3d59e627-e79b-417e-9066-586436d17d42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:32.274178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 255/512] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:32.280941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59e627-e79b-417e-9066-586436d17d42 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.281631 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22df6d8-f82b-4961-a648-d10786c46051 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:32.313584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51f4d5-37ee-4b78-8507-68c812f6879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:32.314271 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51f4d5-37ee-4b78-8507-68c812f6879f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:32.314542 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51f4d5-37ee-4b78-8507-68c812f6879f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:32.314807 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51f4d5-37ee-4b78-8507-68c812f6879f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.333343 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:32.379567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59e627-e79b-417e-9066-586436d17d42 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:32.382311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51f4d5-37ee-4b78-8507-68c812f6879f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.384432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51f4d5-37ee-4b78-8507-68c812f6879f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.414618 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5570f-7dd7-48f5-84c1-99f84fdb77dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:32.415218 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5570f-7dd7-48f5-84c1-99f84fdb77dd None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:32.415491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5570f-7dd7-48f5-84c1-99f84fdb77dd None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:32.415756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5570f-7dd7-48f5-84c1-99f84fdb77dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.436892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:32.483293 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5570f-7dd7-48f5-84c1-99f84fdb77dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.489793 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 258/513] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:32.489793 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51f4d5-37ee-4b78-8507-68c812f6879f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.490070 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5570f-7dd7-48f5-84c1-99f84fdb77dd None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.548127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:32.594549 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 256/514] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:32.595308 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5570f-7dd7-48f5-84c1-99f84fdb77dd None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.597542 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51f4d5-37ee-4b78-8507-68c812f6879f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:32.630649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226dcc-8dd1-481c-9470-d6e1409becf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:32.631272 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226dcc-8dd1-481c-9470-d6e1409becf6 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:32.631548 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226dcc-8dd1-481c-9470-d6e1409becf6 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:32.631818 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226dcc-8dd1-481c-9470-d6e1409becf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.642081 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6226dcc-8dd1-481c-9470-d6e1409becf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.643515 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6226dcc-8dd1-481c-9470-d6e1409becf6 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.647194 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-c6226dcc-8dd1-481c-9470-d6e1409becf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:32.657840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:32.664929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:32.665971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:32.665971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:32.665971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:32.665971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 259/515] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:32.665971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226dcc-8dd1-481c-9470-d6e1409becf6 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.694828 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5570f-7dd7-48f5-84c1-99f84fdb77dd None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:32.749135 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508720d3-c8a0-404e-b42b-eeaded8fa222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:32.749764 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508720d3-c8a0-404e-b42b-eeaded8fa222 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:32.750035 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508720d3-c8a0-404e-b42b-eeaded8fa222 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:32.750302 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508720d3-c8a0-404e-b42b-eeaded8fa222 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.751016 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508720d3-c8a0-404e-b42b-eeaded8fa222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:32.751311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508720d3-c8a0-404e-b42b-eeaded8fa222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.752734 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508720d3-c8a0-404e-b42b-eeaded8fa222 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.765588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226dcc-8dd1-481c-9470-d6e1409becf6 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:32.767112 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:32.771124 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 257/516] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:32.771947 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508720d3-c8a0-404e-b42b-eeaded8fa222 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.799500 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfeccd-c99f-474b-9f15-62b76cb0cec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:32.800122 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfeccd-c99f-474b-9f15-62b76cb0cec4 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:32.800394 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfeccd-c99f-474b-9f15-62b76cb0cec4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:32.800669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfeccd-c99f-474b-9f15-62b76cb0cec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.812718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfeccd-c99f-474b-9f15-62b76cb0cec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.814229 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfeccd-c99f-474b-9f15-62b76cb0cec4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-dabfeccd-c99f-474b-9f15-62b76cb0cec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:32.829306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:32.830393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:32.831455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:32.831455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:32.831455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:32.831455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 260/517] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:32.831455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfeccd-c99f-474b-9f15-62b76cb0cec4 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.888231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508720d3-c8a0-404e-b42b-eeaded8fa222 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:32.901751 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:32.922120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a648281-b5c5-41fd-ac65-f374c714d8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:32.922723 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a648281-b5c5-41fd-ac65-f374c714d8d3 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:32.922998 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a648281-b5c5-41fd-ac65-f374c714d8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:32.923265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a648281-b5c5-41fd-ac65-f374c714d8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.927458 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfeccd-c99f-474b-9f15-62b76cb0cec4 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:32.932935 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a648281-b5c5-41fd-ac65-f374c714d8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.934959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a648281-b5c5-41fd-ac65-f374c714d8d3 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-5a648281-b5c5-41fd-ac65-f374c714d8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:32.950747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:32.951605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:32.952468 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:32.952468 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:32.952468 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:32.952468 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 258/518] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:32.952692 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a648281-b5c5-41fd-ac65-f374c714d8d3 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.967241 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8b3ae-1278-4ca0-af1e-11c9ae137057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:32.967838 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8b3ae-1278-4ca0-af1e-11c9ae137057 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:32.968113 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8b3ae-1278-4ca0-af1e-11c9ae137057 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:32.968384 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8b3ae-1278-4ca0-af1e-11c9ae137057 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:32.969015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8b3ae-1278-4ca0-af1e-11c9ae137057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:32.969348 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8b3ae-1278-4ca0-af1e-11c9ae137057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:32.970701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8b3ae-1278-4ca0-af1e-11c9ae137057 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:32.982541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 261/519] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:32.983318 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8b3ae-1278-4ca0-af1e-11c9ae137057 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:32.998680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:33.056302 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a648281-b5c5-41fd-ac65-f374c714d8d3 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.081525 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8b3ae-1278-4ca0-af1e-11c9ae137057 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.090022 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569885-dc9b-444a-99d2-49cc3612a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.090605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569885-dc9b-444a-99d2-49cc3612a886 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.090881 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569885-dc9b-444a-99d2-49cc3612a886 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.091144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569885-dc9b-444a-99d2-49cc3612a886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.091850 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569885-dc9b-444a-99d2-49cc3612a886 None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=9674e78b7a6b41eb8a00aefff4cd22c1) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:33.092151 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569885-dc9b-444a-99d2-49cc3612a886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.093601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569885-dc9b-444a-99d2-49cc3612a886 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.098665 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 259/520] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/role_assignments?user.id=9674e78b7a6b41eb8a00aefff4cd22c1&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:33.099511 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569885-dc9b-444a-99d2-49cc3612a886 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.117733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1d301-aa16-4b3c-8955-e667362746fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.118366 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1d301-aa16-4b3c-8955-e667362746fb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.118649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1d301-aa16-4b3c-8955-e667362746fb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.118921 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1d301-aa16-4b3c-8955-e667362746fb None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.119590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1d301-aa16-4b3c-8955-e667362746fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:33.120022 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1d301-aa16-4b3c-8955-e667362746fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.121591 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1d301-aa16-4b3c-8955-e667362746fb None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.130762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:33.151489 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 262/521] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:33.151489 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1d301-aa16-4b3c-8955-e667362746fb None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.217617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569885-dc9b-444a-99d2-49cc3612a886 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.223815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:33.250543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1d301-aa16-4b3c-8955-e667362746fb None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.255050 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f00d-25fa-44f9-ba8e-67b1f7f7f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.255707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f00d-25fa-44f9-ba8e-67b1f7f7f547 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.256005 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f00d-25fa-44f9-ba8e-67b1f7f7f547 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.256278 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f00d-25fa-44f9-ba8e-67b1f7f7f547 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.256938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727f00d-25fa-44f9-ba8e-67b1f7f7f547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:33.257272 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727f00d-25fa-44f9-ba8e-67b1f7f7f547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.259138 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727f00d-25fa-44f9-ba8e-67b1f7f7f547 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.272209 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 260/522] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:33.274372 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f00d-25fa-44f9-ba8e-67b1f7f7f547 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.294020 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c904c5-0af5-4a1a-81b6-c0d6a6042715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.294668 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c904c5-0af5-4a1a-81b6-c0d6a6042715 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.294948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c904c5-0af5-4a1a-81b6-c0d6a6042715 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.295218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c904c5-0af5-4a1a-81b6-c0d6a6042715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.304120 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c904c5-0af5-4a1a-81b6-c0d6a6042715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.305989 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c904c5-0af5-4a1a-81b6-c0d6a6042715 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-c8c904c5-0af5-4a1a-81b6-c0d6a6042715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:33.320551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:33.321772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 263/523] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:33.322788 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c904c5-0af5-4a1a-81b6-c0d6a6042715 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.379976 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:33.392511 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f00d-25fa-44f9-ba8e-67b1f7f7f547 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.428895 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c904c5-0af5-4a1a-81b6-c0d6a6042715 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.431050 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78539e4-962f-4f84-8e6d-17a6e648b8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.431673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78539e4-962f-4f84-8e6d-17a6e648b8db None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.431948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78539e4-962f-4f84-8e6d-17a6e648b8db None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.432217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78539e4-962f-4f84-8e6d-17a6e648b8db None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.439074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78539e4-962f-4f84-8e6d-17a6e648b8db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.440517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78539e4-962f-4f84-8e6d-17a6e648b8db None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-a78539e4-962f-4f84-8e6d-17a6e648b8db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:33.454826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:33.455973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:33.457256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:33.457256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:33.457256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:33.457256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:33.457256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:33.457256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:33.457256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:33.457256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:33.461301 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 261/524] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:33.462944 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78539e4-962f-4f84-8e6d-17a6e648b8db None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.473597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7425f-1004-4ccb-bbcc-b5a5460b1457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.474349 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7425f-1004-4ccb-bbcc-b5a5460b1457 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.474724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7425f-1004-4ccb-bbcc-b5a5460b1457 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.475109 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7425f-1004-4ccb-bbcc-b5a5460b1457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.478070 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:33.483659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7425f-1004-4ccb-bbcc-b5a5460b1457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.485243 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7425f-1004-4ccb-bbcc-b5a5460b1457 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-03a7425f-1004-4ccb-bbcc-b5a5460b1457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:33.497466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:33.498564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:33.499607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:33.499607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:33.499607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:33.499607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:33.499607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:33.499607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:33.499607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:33.499607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:33.504925 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 264/525] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:33.504925 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7425f-1004-4ccb-bbcc-b5a5460b1457 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.570742 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78539e4-962f-4f84-8e6d-17a6e648b8db None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.607024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d53c4-1443-4106-b0a5-ccfe452f0f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.607830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d53c4-1443-4106-b0a5-ccfe452f0f95 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.608032 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d53c4-1443-4106-b0a5-ccfe452f0f95 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.608192 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d53c4-1443-4106-b0a5-ccfe452f0f95 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.608818 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d53c4-1443-4106-b0a5-ccfe452f0f95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:33.609118 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d53c4-1443-4106-b0a5-ccfe452f0f95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.610579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d53c4-1443-4106-b0a5-ccfe452f0f95 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.614536 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7425f-1004-4ccb-bbcc-b5a5460b1457 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.622798 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 262/526] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:33.623414 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d53c4-1443-4106-b0a5-ccfe452f0f95 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.636252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:33.655920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c5479-b24f-4e1e-8c3f-368b1da26bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.656524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c5479-b24f-4e1e-8c3f-368b1da26bbf None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.656806 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c5479-b24f-4e1e-8c3f-368b1da26bbf None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.657089 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c5479-b24f-4e1e-8c3f-368b1da26bbf None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.657822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c5479-b24f-4e1e-8c3f-368b1da26bbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:33.658130 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c5479-b24f-4e1e-8c3f-368b1da26bbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.659589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c5479-b24f-4e1e-8c3f-368b1da26bbf None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.683908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 265/527] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:33.683908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c5479-b24f-4e1e-8c3f-368b1da26bbf None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.734632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d53c4-1443-4106-b0a5-ccfe452f0f95 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.740080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:33.770594 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018e7d9-9412-4f04-b6b7-724e5a032517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.771502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e7d9-9412-4f04-b6b7-724e5a032517 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.771781 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e7d9-9412-4f04-b6b7-724e5a032517 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.772053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e7d9-9412-4f04-b6b7-724e5a032517 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.774615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018e7d9-9412-4f04-b6b7-724e5a032517 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:33.774939 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018e7d9-9412-4f04-b6b7-724e5a032517 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.776468 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018e7d9-9412-4f04-b6b7-724e5a032517 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.788655 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 263/528] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:33.791803 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c5479-b24f-4e1e-8c3f-368b1da26bbf None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.795118 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018e7d9-9412-4f04-b6b7-724e5a032517 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.839913 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d1f30-f813-456f-937a-8c95a0fadf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.840672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d1f30-f813-456f-937a-8c95a0fadf2b None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.841043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d1f30-f813-456f-937a-8c95a0fadf2b None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.841401 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d1f30-f813-456f-937a-8c95a0fadf2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.846127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d1f30-f813-456f-937a-8c95a0fadf2b None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=d8200d2f30fa47dc9799dfa26a81109a) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:33.846127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d1f30-f813-456f-937a-8c95a0fadf2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.846127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d1f30-f813-456f-937a-8c95a0fadf2b None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.857214 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 266/529] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/role_assignments?user.id=d8200d2f30fa47dc9799dfa26a81109a&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:33.857214 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d1f30-f813-456f-937a-8c95a0fadf2b None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:33.886382 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:33.924292 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018e7d9-9412-4f04-b6b7-724e5a032517 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:33.967273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08812259-fec6-4952-96f4-6c792de7e2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:33.967971 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08812259-fec6-4952-96f4-6c792de7e2f7 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:33.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08812259-fec6-4952-96f4-6c792de7e2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:33.968676 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08812259-fec6-4952-96f4-6c792de7e2f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:33.969595 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08812259-fec6-4952-96f4-6c792de7e2f7 None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=681cab6042a3486087c55058843deeb2) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:33.969970 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08812259-fec6-4952-96f4-6c792de7e2f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:33.971554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08812259-fec6-4952-96f4-6c792de7e2f7 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:33.978203 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 264/530] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/role_assignments?user.id=681cab6042a3486087c55058843deeb2&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:33.994676 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d1f30-f813-456f-937a-8c95a0fadf2b None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:34.016803 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:34.043533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a19ea-c51b-4906-a11b-e1475ebba847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:34.044183 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a19ea-c51b-4906-a11b-e1475ebba847 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:34.044461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a19ea-c51b-4906-a11b-e1475ebba847 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:34.044730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a19ea-c51b-4906-a11b-e1475ebba847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:34.045515 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a19ea-c51b-4906-a11b-e1475ebba847 None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=ca8186a27e64434f92b8bba23558cf8a) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:34.045827 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a19ea-c51b-4906-a11b-e1475ebba847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:34.047612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a19ea-c51b-4906-a11b-e1475ebba847 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:34.054746 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 267/531] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:33 2022] GET /identity/v3/role_assignments?user.id=ca8186a27e64434f92b8bba23558cf8a&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:35.621199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ffda4-58b9-4983-99be-badaa2e7de48 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:35.622263 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ffda4-58b9-4983-99be-badaa2e7de48 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:35.622824 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ffda4-58b9-4983-99be-badaa2e7de48 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:35.624702 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 265/532] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:35.630390 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955acf0-4657-4228-a890-3d942021b00d None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:35.631265 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955acf0-4657-4228-a890-3d942021b00d None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:35.631750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955acf0-4657-4228-a890-3d942021b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:35.651345 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-9955acf0-4657-4228-a890-3d942021b00d None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:35.652866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-9955acf0-4657-4228-a890-3d942021b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:35.729090 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 268/533] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:36.070200 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ffda4-58b9-4983-99be-badaa2e7de48 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:36.178586 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ffda4-58b9-4983-99be-badaa2e7de48 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:36.213117 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:36.218372 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd72e1f-a1b7-498a-80f0-b8a029774335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:36.219011 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd72e1f-a1b7-498a-80f0-b8a029774335 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.219289 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd72e1f-a1b7-498a-80f0-b8a029774335 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.219562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd72e1f-a1b7-498a-80f0-b8a029774335 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.232462 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd72e1f-a1b7-498a-80f0-b8a029774335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-3cd72e1f-a1b7-498a-80f0-b8a029774335 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:36.237575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:36.238489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:36.239265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:36.243683 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 266/534] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:36.246357 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955acf0-4657-4228-a890-3d942021b00d None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:36.357635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955acf0-4657-4228-a890-3d942021b00d None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:36.372311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:36.394669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c089d5-5264-4c5e-b208-12e5f1c046c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:36.395338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c089d5-5264-4c5e-b208-12e5f1c046c7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.395623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c089d5-5264-4c5e-b208-12e5f1c046c7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.395892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c089d5-5264-4c5e-b208-12e5f1c046c7 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.396554 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c089d5-5264-4c5e-b208-12e5f1c046c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:36.396854 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c089d5-5264-4c5e-b208-12e5f1c046c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:36.398293 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c089d5-5264-4c5e-b208-12e5f1c046c7 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:36.409405 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 269/535] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:36.413678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689b184-c46d-416e-8afc-bbf6216ff8d5 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.414001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689b184-c46d-416e-8afc-bbf6216ff8d5 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.416840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689b184-c46d-416e-8afc-bbf6216ff8d5 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.416952 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c089d5-5264-4c5e-b208-12e5f1c046c7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:36.417045 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 267/536] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:36.422539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b074544-c50f-4ee4-a77f-37eb5f468810 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.422889 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b074544-c50f-4ee4-a77f-37eb5f468810 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.423230 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b074544-c50f-4ee4-a77f-37eb5f468810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.443476 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-6b074544-c50f-4ee4-a77f-37eb5f468810 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:36.444832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-6b074544-c50f-4ee4-a77f-37eb5f468810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:36.532755 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c089d5-5264-4c5e-b208-12e5f1c046c7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:36.553021 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 268/537] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:36.576601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6be5a-3094-489f-940d-6a30496645b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:36.577552 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6be5a-3094-489f-940d-6a30496645b6 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.578046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6be5a-3094-489f-940d-6a30496645b6 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.578511 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6be5a-3094-489f-940d-6a30496645b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.591941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6be5a-3094-489f-940d-6a30496645b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:36.593472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6be5a-3094-489f-940d-6a30496645b6 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-9cc6be5a-3094-489f-940d-6a30496645b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:36.609792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:36.610706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:36.611546 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:36.611546 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:36.611546 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:36.611546 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 270/538] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:36.621747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b074544-c50f-4ee4-a77f-37eb5f468810 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:36.697105 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9eb8f-b39c-4983-b485-b2891aec4664 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.697687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9eb8f-b39c-4983-b485-b2891aec4664 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.697687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9eb8f-b39c-4983-b485-b2891aec4664 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.699440 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 271/539] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:36.700515 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4366a-28d1-4a45-a3ec-0ff1c4b1bcba None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.700800 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4366a-28d1-4a45-a3ec-0ff1c4b1bcba None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.701066 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4366a-28d1-4a45-a3ec-0ff1c4b1bcba None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.702271 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 272/540] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:36.706186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c4653-f6de-4050-a5a4-c760fd0551b2 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.706186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c4653-f6de-4050-a5a4-c760fd0551b2 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.706186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c4653-f6de-4050-a5a4-c760fd0551b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.723887 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-e98c4653-f6de-4050-a5a4-c760fd0551b2 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:36.725061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-e98c4653-f6de-4050-a5a4-c760fd0551b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:36.736713 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b074544-c50f-4ee4-a77f-37eb5f468810 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:36.746183 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:36.767066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:36.780653 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebbd69-e52f-487b-b351-0835e24712c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:36.781320 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbd69-e52f-487b-b351-0835e24712c5 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.781607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbd69-e52f-487b-b351-0835e24712c5 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.781881 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbd69-e52f-487b-b351-0835e24712c5 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.782527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebbd69-e52f-487b-b351-0835e24712c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:36.782830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebbd69-e52f-487b-b351-0835e24712c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:36.784298 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebbd69-e52f-487b-b351-0835e24712c5 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:36.795602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 269/541] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:36.798557 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9f205-6272-40f9-b251-0a7e983c5711 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.798843 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9f205-6272-40f9-b251-0a7e983c5711 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.799116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9f205-6272-40f9-b251-0a7e983c5711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.809207 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 273/542] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:36.809207 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c4653-f6de-4050-a5a4-c760fd0551b2 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:36.824557 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-14a9f205-6272-40f9-b251-0a7e983c5711 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:36.825944 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-14a9f205-6272-40f9-b251-0a7e983c5711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:36.895499 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 270/543] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:36.905071 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9f205-6272-40f9-b251-0a7e983c5711 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:36.937762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c4653-f6de-4050-a5a4-c760fd0551b2 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:36.973321 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c712a-0d2d-4563-80c7-1082179455e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:36.973940 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c712a-0d2d-4563-80c7-1082179455e8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:36.974255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c712a-0d2d-4563-80c7-1082179455e8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:36.974528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c712a-0d2d-4563-80c7-1082179455e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:36.982122 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c712a-0d2d-4563-80c7-1082179455e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:36.983656 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c712a-0d2d-4563-80c7-1082179455e8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-ab8c712a-0d2d-4563-80c7-1082179455e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:36.997151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:36.998171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:36.999049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 274/544] 10.222.0.52 () {56 vars in 1093 bytes} [Sat Sep 17 20:38:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:37.006385 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c712a-0d2d-4563-80c7-1082179455e8 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.029621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:37.043948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9f205-6272-40f9-b251-0a7e983c5711 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.061823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:37.094694 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25df4a3-5d1d-4053-aff9-3393bc03fd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.095605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25df4a3-5d1d-4053-aff9-3393bc03fd71 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.096072 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25df4a3-5d1d-4053-aff9-3393bc03fd71 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.096531 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25df4a3-5d1d-4053-aff9-3393bc03fd71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.110905 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25df4a3-5d1d-4053-aff9-3393bc03fd71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-d25df4a3-5d1d-4053-aff9-3393bc03fd71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:37.117636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:37.118689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:37.119481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:37.126982 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 271/545] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:37.128648 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25df4a3-5d1d-4053-aff9-3393bc03fd71 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.135992 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c712a-0d2d-4563-80c7-1082179455e8 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.174413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b6bd-12bd-420f-bd43-f88dede48682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.175332 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b6bd-12bd-420f-bd43-f88dede48682 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.175614 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b6bd-12bd-420f-bd43-f88dede48682 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.175886 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b6bd-12bd-420f-bd43-f88dede48682 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.176617 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b6bd-12bd-420f-bd43-f88dede48682 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:37.176926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b6bd-12bd-420f-bd43-f88dede48682 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:37.178396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b6bd-12bd-420f-bd43-f88dede48682 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:37.198029 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 275/546] 10.222.0.52 () {56 vars in 1133 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:37.202557 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b6bd-12bd-420f-bd43-f88dede48682 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.245241 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25df4a3-5d1d-4053-aff9-3393bc03fd71 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.280501 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41ad4-d80a-4150-870d-01fe4bf22e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.281963 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:37.282083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41ad4-d80a-4150-870d-01fe4bf22e1d None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.282083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41ad4-d80a-4150-870d-01fe4bf22e1d None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.282083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41ad4-d80a-4150-870d-01fe4bf22e1d None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.282674 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41ad4-d80a-4150-870d-01fe4bf22e1d None admin] RBAC: Adding query filter params (name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:37.282980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41ad4-d80a-4150-870d-01fe4bf22e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:37.284382 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41ad4-d80a-4150-870d-01fe4bf22e1d None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:37.294663 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 272/547] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:37.295480 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41ad4-d80a-4150-870d-01fe4bf22e1d None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.311397 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b6bd-12bd-420f-bd43-f88dede48682 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.332070 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:37.346486 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18195e5e-31d0-47e7-8985-c349cd0a2abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.347218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18195e5e-31d0-47e7-8985-c349cd0a2abe None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.347513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18195e5e-31d0-47e7-8985-c349cd0a2abe None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.347765 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18195e5e-31d0-47e7-8985-c349cd0a2abe None admin] PATH_INFO: `/v3/roles/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.358709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18195e5e-31d0-47e7-8985-c349cd0a2abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-18195e5e-31d0-47e7-8985-c349cd0a2abe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:37.363424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:37.364396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:37.365228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 276/548] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:37.365892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18195e5e-31d0-47e7-8985-c349cd0a2abe None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.401994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41ad4-d80a-4150-870d-01fe4bf22e1d None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.435130 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ac6d-01ab-4028-9f89-085636579e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.435665 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ac6d-01ab-4028-9f89-085636579e6c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.435937 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ac6d-01ab-4028-9f89-085636579e6c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.436201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ac6d-01ab-4028-9f89-085636579e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.447241 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28ac6d-01ab-4028-9f89-085636579e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:37.448677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28ac6d-01ab-4028-9f89-085636579e6c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-1b28ac6d-01ab-4028-9f89-085636579e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:37.462919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:37.463869 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:37.469271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:37.469271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:37.469271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:37.469271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 273/549] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:37.469271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ac6d-01ab-4028-9f89-085636579e6c None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.469621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18195e5e-31d0-47e7-8985-c349cd0a2abe None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.501150 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6553b-d0ba-4988-bff0-13dcc98cb1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.501794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6553b-d0ba-4988-bff0-13dcc98cb1a0 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.502726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6553b-d0ba-4988-bff0-13dcc98cb1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.502726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6553b-d0ba-4988-bff0-13dcc98cb1a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.504164 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:37.512846 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6553b-d0ba-4988-bff0-13dcc98cb1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-5ec6553b-d0ba-4988-bff0-13dcc98cb1a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:37.517590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:37.519044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 277/550] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:37.519996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6553b-d0ba-4988-bff0-13dcc98cb1a0 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.556861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:37.568559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ac6d-01ab-4028-9f89-085636579e6c None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.610266 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d06b71-2ade-44bc-aa8d-413f74361795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.610893 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d06b71-2ade-44bc-aa8d-413f74361795 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.611167 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d06b71-2ade-44bc-aa8d-413f74361795 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.611432 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d06b71-2ade-44bc-aa8d-413f74361795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.625840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d06b71-2ade-44bc-aa8d-413f74361795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:37.626991 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6553b-d0ba-4988-bff0-13dcc98cb1a0 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.627943 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d06b71-2ade-44bc-aa8d-413f74361795 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-21d06b71-2ade-44bc-aa8d-413f74361795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:37.642888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:37.643862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:37.644859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:37.644859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:37.644859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:37.644859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 274/551] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:37.644859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d06b71-2ade-44bc-aa8d-413f74361795 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.668233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505f4a4-b97b-4182-bca2-59f61b25029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.668829 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505f4a4-b97b-4182-bca2-59f61b25029f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.669103 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505f4a4-b97b-4182-bca2-59f61b25029f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.669408 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505f4a4-b97b-4182-bca2-59f61b25029f None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.670054 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505f4a4-b97b-4182-bca2-59f61b25029f None admin] RBAC: Adding query filter params (name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:37.670352 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505f4a4-b97b-4182-bca2-59f61b25029f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:37.671723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505f4a4-b97b-4182-bca2-59f61b25029f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:37.679468 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 278/552] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:37.680412 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505f4a4-b97b-4182-bca2-59f61b25029f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.736872 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:37.746151 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d06b71-2ade-44bc-aa8d-413f74361795 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.778968 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505f4a4-b97b-4182-bca2-59f61b25029f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.779624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9784-4ca0-409b-ab0d-7e9e1f64ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.780221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9784-4ca0-409b-ab0d-7e9e1f64ddea None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.780495 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9784-4ca0-409b-ab0d-7e9e1f64ddea None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.780761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9784-4ca0-409b-ab0d-7e9e1f64ddea None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.781572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9784-4ca0-409b-ab0d-7e9e1f64ddea None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:37.781871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9784-4ca0-409b-ab0d-7e9e1f64ddea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:37.783243 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9784-4ca0-409b-ab0d-7e9e1f64ddea None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:37.790684 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:37.795720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 275/553] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:37.796494 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9784-4ca0-409b-ab0d-7e9e1f64ddea None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.821146 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dba61-8698-4a1d-8f6b-8103e1843545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.821743 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dba61-8698-4a1d-8f6b-8103e1843545 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.821953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dba61-8698-4a1d-8f6b-8103e1843545 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.822303 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dba61-8698-4a1d-8f6b-8103e1843545 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.822984 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dba61-8698-4a1d-8f6b-8103e1843545 None admin] RBAC: Adding query filter params (name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:37.823289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dba61-8698-4a1d-8f6b-8103e1843545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:37.824654 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dba61-8698-4a1d-8f6b-8103e1843545 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:37.832420 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 279/554] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:37.833317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dba61-8698-4a1d-8f6b-8103e1843545 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.907078 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9784-4ca0-409b-ab0d-7e9e1f64ddea None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.946255 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dba61-8698-4a1d-8f6b-8103e1843545 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:37.949352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeae059-1172-4985-a4d0-6530101776f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.949946 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeae059-1172-4985-a4d0-6530101776f4 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.950220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeae059-1172-4985-a4d0-6530101776f4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.950485 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeae059-1172-4985-a4d0-6530101776f4 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.951114 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeae059-1172-4985-a4d0-6530101776f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:37.951407 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeae059-1172-4985-a4d0-6530101776f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:37.952771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeae059-1172-4985-a4d0-6530101776f4 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:37.964958 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 276/555] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:37.965196 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:37.967842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeae059-1172-4985-a4d0-6530101776f4 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:37.982845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef5f29-0316-459e-952f-30a117512473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:37.983478 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5f29-0316-459e-952f-30a117512473 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:37.983762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5f29-0316-459e-952f-30a117512473 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:37.984041 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5f29-0316-459e-952f-30a117512473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:37.995306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef5f29-0316-459e-952f-30a117512473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:37.996701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef5f29-0316-459e-952f-30a117512473 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-59ef5f29-0316-459e-952f-30a117512473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:38.011819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:38.012759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:38.013679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:38.013679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:38.013679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:38.013679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 280/556] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:38.015108 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef5f29-0316-459e-952f-30a117512473 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.027512 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:38.068052 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeae059-1172-4985-a4d0-6530101776f4 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.101571 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f6a4d-a424-45ec-9a3d-87910cbed48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.102257 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f6a4d-a424-45ec-9a3d-87910cbed48b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.102539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f6a4d-a424-45ec-9a3d-87910cbed48b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.102818 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f6a4d-a424-45ec-9a3d-87910cbed48b None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.109277 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f6a4d-a424-45ec-9a3d-87910cbed48b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.110700 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f6a4d-a424-45ec-9a3d-87910cbed48b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.112874 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef5f29-0316-459e-952f-30a117512473 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-502f6a4d-a424-45ec-9a3d-87910cbed48b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:38.121768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:38.122830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 277/557] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:38.123912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f6a4d-a424-45ec-9a3d-87910cbed48b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.148056 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a66d14-e6f3-4f83-872e-214d51f765d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.148799 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a66d14-e6f3-4f83-872e-214d51f765d9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.149100 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a66d14-e6f3-4f83-872e-214d51f765d9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.149413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a66d14-e6f3-4f83-872e-214d51f765d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.160234 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a66d14-e6f3-4f83-872e-214d51f765d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.161731 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a66d14-e6f3-4f83-872e-214d51f765d9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-f4a66d14-e6f3-4f83-872e-214d51f765d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:38.176147 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:38.177632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:38.178486 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:38.178486 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:38.178486 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:38.178486 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 281/558] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:38.178486 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a66d14-e6f3-4f83-872e-214d51f765d9 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.206597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:38.225028 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f6a4d-a424-45ec-9a3d-87910cbed48b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.248160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:38.267365 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4944e0-d7e6-41a2-b7d4-1564dffa1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.267981 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4944e0-d7e6-41a2-b7d4-1564dffa1e66 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.268255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4944e0-d7e6-41a2-b7d4-1564dffa1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.268524 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4944e0-d7e6-41a2-b7d4-1564dffa1e66 None admin] PATH_INFO: `/v3/users/glance` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.279615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4944e0-d7e6-41a2-b7d4-1564dffa1e66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.282419 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4944e0-d7e6-41a2-b7d4-1564dffa1e66 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.289032 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a66d14-e6f3-4f83-872e-214d51f765d9 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-1f4944e0-d7e6-41a2-b7d4-1564dffa1e66 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:38.299491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:38.300449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:38.301506 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 278/559] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:38.302272 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4944e0-d7e6-41a2-b7d4-1564dffa1e66 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.324960 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02a03-171e-4743-bb6b-82d5be194250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.325605 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02a03-171e-4743-bb6b-82d5be194250 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.325887 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02a03-171e-4743-bb6b-82d5be194250 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.326160 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02a03-171e-4743-bb6b-82d5be194250 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.326796 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea02a03-171e-4743-bb6b-82d5be194250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:38.327099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea02a03-171e-4743-bb6b-82d5be194250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.328476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea02a03-171e-4743-bb6b-82d5be194250 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.341156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 282/560] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:38.341966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02a03-171e-4743-bb6b-82d5be194250 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.416718 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4944e0-d7e6-41a2-b7d4-1564dffa1e66 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.421867 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:38.441037 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02a03-171e-4743-bb6b-82d5be194250 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.450715 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66adaf-19c0-4798-9997-3a6cb314f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.451305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66adaf-19c0-4798-9997-3a6cb314f346 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.451578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66adaf-19c0-4798-9997-3a6cb314f346 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.451844 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66adaf-19c0-4798-9997-3a6cb314f346 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.452521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66adaf-19c0-4798-9997-3a6cb314f346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:38.452820 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66adaf-19c0-4798-9997-3a6cb314f346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.454262 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66adaf-19c0-4798-9997-3a6cb314f346 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.466901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 279/561] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:38.467688 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66adaf-19c0-4798-9997-3a6cb314f346 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.479804 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758df03c-6600-452a-9bda-39bed612839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.480709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758df03c-6600-452a-9bda-39bed612839d None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.480990 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758df03c-6600-452a-9bda-39bed612839d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.481441 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758df03c-6600-452a-9bda-39bed612839d None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.482075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758df03c-6600-452a-9bda-39bed612839d None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:38.482372 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758df03c-6600-452a-9bda-39bed612839d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.483728 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758df03c-6600-452a-9bda-39bed612839d None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.494605 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 283/562] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:38.495374 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758df03c-6600-452a-9bda-39bed612839d None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.512002 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:38.576635 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66adaf-19c0-4798-9997-3a6cb314f346 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.601411 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758df03c-6600-452a-9bda-39bed612839d None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.615619 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5458ac9-7f43-4fd2-a0be-f15d0118c0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.616206 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5458ac9-7f43-4fd2-a0be-f15d0118c0b6 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.616477 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5458ac9-7f43-4fd2-a0be-f15d0118c0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.616750 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5458ac9-7f43-4fd2-a0be-f15d0118c0b6 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.618143 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5458ac9-7f43-4fd2-a0be-f15d0118c0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:38.618439 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5458ac9-7f43-4fd2-a0be-f15d0118c0b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.619844 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5458ac9-7f43-4fd2-a0be-f15d0118c0b6 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.637188 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 280/563] 10.222.0.52 () {56 vars in 1137 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:38.637970 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5458ac9-7f43-4fd2-a0be-f15d0118c0b6 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.652594 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be60220-c2d7-4110-8d3e-e50c66cbef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.653263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60220-c2d7-4110-8d3e-e50c66cbef7b None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.653545 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60220-c2d7-4110-8d3e-e50c66cbef7b None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.653814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60220-c2d7-4110-8d3e-e50c66cbef7b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.662060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be60220-c2d7-4110-8d3e-e50c66cbef7b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.663531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be60220-c2d7-4110-8d3e-e50c66cbef7b None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-7be60220-c2d7-4110-8d3e-e50c66cbef7b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:38.674864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:38.676047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 284/564] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:38.677006 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be60220-c2d7-4110-8d3e-e50c66cbef7b None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.680133 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:38.736900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:38.743673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5458ac9-7f43-4fd2-a0be-f15d0118c0b6 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.776202 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be60220-c2d7-4110-8d3e-e50c66cbef7b None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:38.781714 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fad34d-2933-42d4-8369-46c21c081e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.782462 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad34d-2933-42d4-8369-46c21c081e62 None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.782739 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad34d-2933-42d4-8369-46c21c081e62 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.783011 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad34d-2933-42d4-8369-46c21c081e62 None admin] PATH_INFO: `/v3/projects/8626e1dba10a49f2a16ae81553658423/users/9674e78b7a6b41eb8a00aefff4cd22c1/roles/7a5931f5b557440d8144632a8e5834e6` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.798776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fad34d-2933-42d4-8369-46c21c081e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=8626e1dba10a49f2a16ae81553658423, user_id=9674e78b7a6b41eb8a00aefff4cd22c1, role_id=7a5931f5b557440d8144632a8e5834e6)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.800210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fad34d-2933-42d4-8369-46c21c081e62 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.813103 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de87b-d6f9-4ad1-9cd4-ecc79ce1bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:38.813755 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de87b-d6f9-4ad1-9cd4-ecc79ce1bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:38.814039 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de87b-d6f9-4ad1-9cd4-ecc79ce1bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:38.814297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de87b-d6f9-4ad1-9cd4-ecc79ce1bfb5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:38.822314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170de87b-d6f9-4ad1-9cd4-ecc79ce1bfb5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:38.827085 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170de87b-d6f9-4ad1-9cd4-ecc79ce1bfb5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-170de87b-d6f9-4ad1-9cd4-ecc79ce1bfb5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:38.834560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:38.835603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:38.836720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 285/565] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:38.838050 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de87b-d6f9-4ad1-9cd4-ecc79ce1bfb5 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.896814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:38.904692 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 281/566] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:38:38 2022] PUT /identity/v3/projects/8626e1dba10a49f2a16ae81553658423/users/9674e78b7a6b41eb8a00aefff4cd22c1/roles/7a5931f5b557440d8144632a8e5834e6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:38.904692 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fad34d-2933-42d4-8369-46c21c081e62 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:38.960289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de87b-d6f9-4ad1-9cd4-ecc79ce1bfb5 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.002766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d6440-afda-4bbc-b073-4b75a7007a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.003402 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d6440-afda-4bbc-b073-4b75a7007a3d None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.003687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d6440-afda-4bbc-b073-4b75a7007a3d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.003958 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d6440-afda-4bbc-b073-4b75a7007a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.016564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d6440-afda-4bbc-b073-4b75a7007a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.018084 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d6440-afda-4bbc-b073-4b75a7007a3d None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.028657 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fad34d-2933-42d4-8369-46c21c081e62 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-569d6440-afda-4bbc-b073-4b75a7007a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:39.034602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:39.041052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:39.042233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:39.042233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:39.042233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:39.042233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 286/567] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:39.042233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d6440-afda-4bbc-b073-4b75a7007a3d None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.074739 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779be19-08c9-4baa-b152-ae9527f10e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.075467 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779be19-08c9-4baa-b152-ae9527f10e36 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.075821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779be19-08c9-4baa-b152-ae9527f10e36 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.076167 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779be19-08c9-4baa-b152-ae9527f10e36 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.077056 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779be19-08c9-4baa-b152-ae9527f10e36 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:39.077463 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779be19-08c9-4baa-b152-ae9527f10e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.079233 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779be19-08c9-4baa-b152-ae9527f10e36 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.104494 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 282/568] 10.222.0.52 () {56 vars in 1139 bytes} [Sat Sep 17 20:38:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:39.105273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779be19-08c9-4baa-b152-ae9527f10e36 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.109971 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:39.158963 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d6440-afda-4bbc-b073-4b75a7007a3d None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.177579 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:39.199435 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65305a5-9fee-46fe-8a01-a3b6d4101a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.200357 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65305a5-9fee-46fe-8a01-a3b6d4101a22 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.200497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65305a5-9fee-46fe-8a01-a3b6d4101a22 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.200668 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65305a5-9fee-46fe-8a01-a3b6d4101a22 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.201421 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65305a5-9fee-46fe-8a01-a3b6d4101a22 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:39.201730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65305a5-9fee-46fe-8a01-a3b6d4101a22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.203173 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65305a5-9fee-46fe-8a01-a3b6d4101a22 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.217190 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779be19-08c9-4baa-b152-ae9527f10e36 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.222833 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 287/569] 10.222.0.52 () {56 vars in 1137 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:39.226758 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65305a5-9fee-46fe-8a01-a3b6d4101a22 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.254575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361e71-ebeb-4420-9599-e1f722c003b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.255308 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361e71-ebeb-4420-9599-e1f722c003b0 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.255914 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361e71-ebeb-4420-9599-e1f722c003b0 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.256060 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361e71-ebeb-4420-9599-e1f722c003b0 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.256699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e361e71-ebeb-4420-9599-e1f722c003b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:39.257125 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e361e71-ebeb-4420-9599-e1f722c003b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.258687 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e361e71-ebeb-4420-9599-e1f722c003b0 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.270412 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 283/570] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:39.271325 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361e71-ebeb-4420-9599-e1f722c003b0 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.337052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65305a5-9fee-46fe-8a01-a3b6d4101a22 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.340946 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:39.372191 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30548b5-5452-4fbf-8152-e4332157fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.372816 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30548b5-5452-4fbf-8152-e4332157fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.373095 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30548b5-5452-4fbf-8152-e4332157fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.373398 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30548b5-5452-4fbf-8152-e4332157fdd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.382235 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361e71-ebeb-4420-9599-e1f722c003b0 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.384566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30548b5-5452-4fbf-8152-e4332157fdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.386927 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30548b5-5452-4fbf-8152-e4332157fdd2 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-f30548b5-5452-4fbf-8152-e4332157fdd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:39.405482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:39.406528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:39.407445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:39.407445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:39.407445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:39.407445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 288/571] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:39.407445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30548b5-5452-4fbf-8152-e4332157fdd2 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.425856 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d6e79-d186-4958-86b6-5d75912c7dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.426793 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d6e79-d186-4958-86b6-5d75912c7dbd None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.427066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d6e79-d186-4958-86b6-5d75912c7dbd None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.427365 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d6e79-d186-4958-86b6-5d75912c7dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.437064 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:39.438905 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d6e79-d186-4958-86b6-5d75912c7dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.440404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d6e79-d186-4958-86b6-5d75912c7dbd None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-157d6e79-d186-4958-86b6-5d75912c7dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:39.455677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:39.465408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:39.466519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:39.466519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:39.466519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:39.466519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 284/572] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:39.466519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d6e79-d186-4958-86b6-5d75912c7dbd None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.519797 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30548b5-5452-4fbf-8152-e4332157fdd2 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.555154 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f808ef-051a-4734-8755-ba800ac7f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.555884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f808ef-051a-4734-8755-ba800ac7f342 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.556163 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f808ef-051a-4734-8755-ba800ac7f342 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.556440 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f808ef-051a-4734-8755-ba800ac7f342 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.562090 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d6e79-d186-4958-86b6-5d75912c7dbd None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.562999 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f808ef-051a-4734-8755-ba800ac7f342 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.564444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f808ef-051a-4734-8755-ba800ac7f342 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-13f808ef-051a-4734-8755-ba800ac7f342 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:39.576444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:39.577562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 289/573] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:39.578624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f808ef-051a-4734-8755-ba800ac7f342 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.586903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:39.607519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a9b9a-93eb-4dc8-99f6-ce4a4322e75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.608115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a9b9a-93eb-4dc8-99f6-ce4a4322e75f None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.608457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a9b9a-93eb-4dc8-99f6-ce4a4322e75f None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.608796 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a9b9a-93eb-4dc8-99f6-ce4a4322e75f None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.609519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a9b9a-93eb-4dc8-99f6-ce4a4322e75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:39.609883 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a9b9a-93eb-4dc8-99f6-ce4a4322e75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.611309 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a9b9a-93eb-4dc8-99f6-ce4a4322e75f None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.624877 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 285/574] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:39.625958 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a9b9a-93eb-4dc8-99f6-ce4a4322e75f None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.674297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:39.691421 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f808ef-051a-4734-8755-ba800ac7f342 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.729753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a9b9a-93eb-4dc8-99f6-ce4a4322e75f None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.730279 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52acf3-9249-4753-ad3b-eec1db3bed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.730653 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52acf3-9249-4753-ad3b-eec1db3bed3c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.731035 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52acf3-9249-4753-ad3b-eec1db3bed3c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.731517 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52acf3-9249-4753-ad3b-eec1db3bed3c None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.732372 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52acf3-9249-4753-ad3b-eec1db3bed3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:39.732775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52acf3-9249-4753-ad3b-eec1db3bed3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.734276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52acf3-9249-4753-ad3b-eec1db3bed3c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.750472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 290/575] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:39.750472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52acf3-9249-4753-ad3b-eec1db3bed3c None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.769486 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32385110-0636-42ea-a71d-13dda64a3e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.770085 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385110-0636-42ea-a71d-13dda64a3e5f None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.770357 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385110-0636-42ea-a71d-13dda64a3e5f None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.770624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385110-0636-42ea-a71d-13dda64a3e5f None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.771302 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32385110-0636-42ea-a71d-13dda64a3e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:39.771624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32385110-0636-42ea-a71d-13dda64a3e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.773005 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32385110-0636-42ea-a71d-13dda64a3e5f None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.789291 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 286/576] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:39.790147 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32385110-0636-42ea-a71d-13dda64a3e5f None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.832424 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:39.856135 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52acf3-9249-4753-ad3b-eec1db3bed3c None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.895343 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a2a1-10d3-4002-840a-9714a79dde27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.895967 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a2a1-10d3-4002-840a-9714a79dde27 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.896494 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a2a1-10d3-4002-840a-9714a79dde27 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.896494 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a2a1-10d3-4002-840a-9714a79dde27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.899912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32385110-0636-42ea-a71d-13dda64a3e5f None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:39.903924 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7a2a1-10d3-4002-840a-9714a79dde27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.905389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7a2a1-10d3-4002-840a-9714a79dde27 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-43b7a2a1-10d3-4002-840a-9714a79dde27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:39.916733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:39.917802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 291/577] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:39.923774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a2a1-10d3-4002-840a-9714a79dde27 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:39.924424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:39.942407 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4437e5-db80-4e22-bead-3716668bd84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:39.943308 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4437e5-db80-4e22-bead-3716668bd84c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:39.943671 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4437e5-db80-4e22-bead-3716668bd84c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:39.943948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4437e5-db80-4e22-bead-3716668bd84c None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:39.951298 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4437e5-db80-4e22-bead-3716668bd84c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:39.952731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4437e5-db80-4e22-bead-3716668bd84c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-5c4437e5-db80-4e22-bead-3716668bd84c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:39.967425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:39.968341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:39.969254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:39.969254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:39.969254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:39.969254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:39.969254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:39.969254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:39.969254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:39.969254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:39.969254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 287/578] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:39.969834 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4437e5-db80-4e22-bead-3716668bd84c None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:40.035198 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a2a1-10d3-4002-840a-9714a79dde27 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:40.069611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55d4b0-c8ee-446c-bd76-42ac57138e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:40.070842 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55d4b0-c8ee-446c-bd76-42ac57138e11 None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:40.071114 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55d4b0-c8ee-446c-bd76-42ac57138e11 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:40.071380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55d4b0-c8ee-446c-bd76-42ac57138e11 None admin] PATH_INFO: `/v3/projects/8626e1dba10a49f2a16ae81553658423/users/d8200d2f30fa47dc9799dfa26a81109a/roles/7a5931f5b557440d8144632a8e5834e6` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:40.080785 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:40.089114 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55d4b0-c8ee-446c-bd76-42ac57138e11 None admin] RBAC: Authorizing `identity:create_grant(project_id=8626e1dba10a49f2a16ae81553658423, user_id=d8200d2f30fa47dc9799dfa26a81109a, role_id=7a5931f5b557440d8144632a8e5834e6)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:40.089297 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4437e5-db80-4e22-bead-3716668bd84c None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:40.094397 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55d4b0-c8ee-446c-bd76-42ac57138e11 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:40.125703 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2d838-3d35-42d7-8698-b80684ba83cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:40.126296 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2d838-3d35-42d7-8698-b80684ba83cf None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:40.126592 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2d838-3d35-42d7-8698-b80684ba83cf None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:40.126954 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2d838-3d35-42d7-8698-b80684ba83cf None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:40.127633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2d838-3d35-42d7-8698-b80684ba83cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:40.127931 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2d838-3d35-42d7-8698-b80684ba83cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:40.129381 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2d838-3d35-42d7-8698-b80684ba83cf None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:40.142724 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 288/579] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:40.143342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2d838-3d35-42d7-8698-b80684ba83cf None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:40.175819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 292/580] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:38:39 2022] PUT /identity/v3/projects/8626e1dba10a49f2a16ae81553658423/users/d8200d2f30fa47dc9799dfa26a81109a/roles/7a5931f5b557440d8144632a8e5834e6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:40.177013 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55d4b0-c8ee-446c-bd76-42ac57138e11 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:40.244064 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:40.283853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2d838-3d35-42d7-8698-b80684ba83cf None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:40.294334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55d4b0-c8ee-446c-bd76-42ac57138e11 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:40.336600 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf18929-e306-4ab8-aaca-4fe3d3d68435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:40.337696 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf18929-e306-4ab8-aaca-4fe3d3d68435 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:40.338292 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf18929-e306-4ab8-aaca-4fe3d3d68435 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:40.338762 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf18929-e306-4ab8-aaca-4fe3d3d68435 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:40.338935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12346311-6a7d-4e63-9406-ceac8baafd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:40.339612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12346311-6a7d-4e63-9406-ceac8baafd5e None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:40.339968 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12346311-6a7d-4e63-9406-ceac8baafd5e None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:40.340243 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12346311-6a7d-4e63-9406-ceac8baafd5e None admin] PATH_INFO: `/v3/projects/8626e1dba10a49f2a16ae81553658423/users/ca8186a27e64434f92b8bba23558cf8a/roles/7a5931f5b557440d8144632a8e5834e6` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:40.340563 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf18929-e306-4ab8-aaca-4fe3d3d68435 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:40.341143 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf18929-e306-4ab8-aaca-4fe3d3d68435 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:40.343008 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf18929-e306-4ab8-aaca-4fe3d3d68435 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:40.357127 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 289/581] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:40.359606 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12346311-6a7d-4e63-9406-ceac8baafd5e None admin] RBAC: Authorizing `identity:create_grant(project_id=8626e1dba10a49f2a16ae81553658423, user_id=ca8186a27e64434f92b8bba23558cf8a, role_id=7a5931f5b557440d8144632a8e5834e6)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:40.361104 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12346311-6a7d-4e63-9406-ceac8baafd5e None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:40.362565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf18929-e306-4ab8-aaca-4fe3d3d68435 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:40.385063 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:40.475475 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 293/582] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:38:40 2022] PUT /identity/v3/projects/8626e1dba10a49f2a16ae81553658423/users/ca8186a27e64434f92b8bba23558cf8a/roles/7a5931f5b557440d8144632a8e5834e6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:40.484793 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf18929-e306-4ab8-aaca-4fe3d3d68435 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:40.525630 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6e072-5a89-456f-854d-ed0390dc67cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:40.526365 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6e072-5a89-456f-854d-ed0390dc67cb None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:40.526647 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6e072-5a89-456f-854d-ed0390dc67cb None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:40.526920 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6e072-5a89-456f-854d-ed0390dc67cb None admin] PATH_INFO: `/v3/projects/8626e1dba10a49f2a16ae81553658423/users/681cab6042a3486087c55058843deeb2/roles/7a5931f5b557440d8144632a8e5834e6` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:40.545242 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6e072-5a89-456f-854d-ed0390dc67cb None admin] RBAC: Authorizing `identity:create_grant(project_id=8626e1dba10a49f2a16ae81553658423, user_id=681cab6042a3486087c55058843deeb2, role_id=7a5931f5b557440d8144632a8e5834e6)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:40.546776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6e072-5a89-456f-854d-ed0390dc67cb None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:40.629850 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 290/583] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:38:40 2022] PUT /identity/v3/projects/8626e1dba10a49f2a16ae81553658423/users/681cab6042a3486087c55058843deeb2/roles/7a5931f5b557440d8144632a8e5834e6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:41.377120 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa32dc-75a4-45ca-ab59-fb8fea2ca0e7 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:41.377665 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa32dc-75a4-45ca-ab59-fb8fea2ca0e7 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:41.377745 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa32dc-75a4-45ca-ab59-fb8fea2ca0e7 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:41.379311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 294/584] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:41.385584 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db67b-c059-460a-b199-129c496b1b0b None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:41.386014 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db67b-c059-460a-b199-129c496b1b0b None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:41.386111 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db67b-c059-460a-b199-129c496b1b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:41.404935 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-9f4db67b-c059-460a-b199-129c496b1b0b None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:41.406181 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-9f4db67b-c059-460a-b199-129c496b1b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:41.471937 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:41.480425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 291/585] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:41.811603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa32dc-75a4-45ca-ab59-fb8fea2ca0e7 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:41.921795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa32dc-75a4-45ca-ab59-fb8fea2ca0e7 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:41.924133 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:41.957194 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa1f13-ab99-4652-ba38-cf49dcd0cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:41.958111 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1f13-ab99-4652-ba38-cf49dcd0cc13 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:41.958542 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1f13-ab99-4652-ba38-cf49dcd0cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:41.958962 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1f13-ab99-4652-ba38-cf49dcd0cc13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:41.970554 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa1f13-ab99-4652-ba38-cf49dcd0cc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-92fa1f13-ab99-4652-ba38-cf49dcd0cc13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:41.975681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:41.976980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:41.978053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:41.980202 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 295/586] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:41.985948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db67b-c059-460a-b199-129c496b1b0b None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:42.095503 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db67b-c059-460a-b199-129c496b1b0b None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:42.130918 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63102-ad2e-4b8b-b2d7-d29216a1e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:42.131515 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63102-ad2e-4b8b-b2d7-d29216a1e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:42.131789 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63102-ad2e-4b8b-b2d7-d29216a1e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:42.132115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63102-ad2e-4b8b-b2d7-d29216a1e5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:42.132840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d63102-ad2e-4b8b-b2d7-d29216a1e5c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:42.133137 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d63102-ad2e-4b8b-b2d7-d29216a1e5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:42.134519 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d63102-ad2e-4b8b-b2d7-d29216a1e5c1 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:42.143157 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 292/587] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:42.149513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa1f13-ab99-4652-ba38-cf49dcd0cc13 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:42.257802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa1f13-ab99-4652-ba38-cf49dcd0cc13 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:42.297454 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89664ad8-bc5d-4e47-bfa2-e2739f83447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:42.298391 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89664ad8-bc5d-4e47-bfa2-e2739f83447c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:42.298855 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89664ad8-bc5d-4e47-bfa2-e2739f83447c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:42.299331 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89664ad8-bc5d-4e47-bfa2-e2739f83447c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:42.310818 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89664ad8-bc5d-4e47-bfa2-e2739f83447c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:42.312494 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89664ad8-bc5d-4e47-bfa2-e2739f83447c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-89664ad8-bc5d-4e47-bfa2-e2739f83447c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:42.327336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:42.328282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:42.329157 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:42.329157 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:42.329157 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:42.330998 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 296/588] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:42.341212 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63102-ad2e-4b8b-b2d7-d29216a1e5c1 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:42.402738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:42.447763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63102-ad2e-4b8b-b2d7-d29216a1e5c1 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:42.485900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e194ac-2e1d-42f2-9271-85aee7f00be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:42.486801 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e194ac-2e1d-42f2-9271-85aee7f00be7 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:42.487260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e194ac-2e1d-42f2-9271-85aee7f00be7 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:42.487743 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e194ac-2e1d-42f2-9271-85aee7f00be7 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:42.488560 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e194ac-2e1d-42f2-9271-85aee7f00be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:42.489039 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e194ac-2e1d-42f2-9271-85aee7f00be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:42.490691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e194ac-2e1d-42f2-9271-85aee7f00be7 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:42.509287 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 293/589] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:42.511263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89664ad8-bc5d-4e47-bfa2-e2739f83447c None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:42.531973 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:42.618153 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89664ad8-bc5d-4e47-bfa2-e2739f83447c None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:42.656275 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aa29d-5ad0-4b98-982c-86e86007c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:42.657263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa29d-5ad0-4b98-982c-86e86007c472 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:42.657763 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa29d-5ad0-4b98-982c-86e86007c472 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:42.658213 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa29d-5ad0-4b98-982c-86e86007c472 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:42.668115 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aa29d-5ad0-4b98-982c-86e86007c472 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:42.669945 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aa29d-5ad0-4b98-982c-86e86007c472 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-8a5aa29d-5ad0-4b98-982c-86e86007c472 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:42.683414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:42.684442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:42.685488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:42.692033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 297/590] 10.222.0.52 () {56 vars in 1093 bytes} [Sat Sep 17 20:38:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:42.693866 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e194ac-2e1d-42f2-9271-85aee7f00be7 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:42.731512 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ead21-7b36-4ff2-ba4b-3b07b6c2951d None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:42.732065 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ead21-7b36-4ff2-ba4b-3b07b6c2951d None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:42.732487 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ead21-7b36-4ff2-ba4b-3b07b6c2951d None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:42.734757 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 298/591] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:42.740851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c4eef-4f52-4b75-8921-274e53ec76da None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:42.741389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c4eef-4f52-4b75-8921-274e53ec76da None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:42.741905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c4eef-4f52-4b75-8921-274e53ec76da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:42.767097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-567c4eef-4f52-4b75-8921-274e53ec76da None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:42.769596 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-567c4eef-4f52-4b75-8921-274e53ec76da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:42.822954 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e194ac-2e1d-42f2-9271-85aee7f00be7 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:42.842426 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:42.864258 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c07512-886c-4d58-a17f-ed2933f62d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:42.865071 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c07512-886c-4d58-a17f-ed2933f62d31 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:42.865413 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c07512-886c-4d58-a17f-ed2933f62d31 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:42.865775 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c07512-886c-4d58-a17f-ed2933f62d31 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:42.866613 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c07512-886c-4d58-a17f-ed2933f62d31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:42.867758 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c07512-886c-4d58-a17f-ed2933f62d31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:42.869373 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c07512-886c-4d58-a17f-ed2933f62d31 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:42.873401 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 299/592] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:42.903982 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 294/593] 10.222.0.52 () {56 vars in 1133 bytes} [Sat Sep 17 20:38:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:42.909804 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c4eef-4f52-4b75-8921-274e53ec76da None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:42.919447 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:43.013917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c4eef-4f52-4b75-8921-274e53ec76da None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:43.049510 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed584-0231-43e7-b89f-8d55874a911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:43.050408 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed584-0231-43e7-b89f-8d55874a911c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.050833 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed584-0231-43e7-b89f-8d55874a911c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.051270 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed584-0231-43e7-b89f-8d55874a911c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.122972 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252ae4-b7d2-45c3-a639-32b1dd4765e9 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.123325 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252ae4-b7d2-45c3-a639-32b1dd4765e9 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.123531 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252ae4-b7d2-45c3-a639-32b1dd4765e9 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.124840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 295/594] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:43.126928 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bed584-0231-43e7-b89f-8d55874a911c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:43.128399 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bed584-0231-43e7-b89f-8d55874a911c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:43.130551 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8812718-8daa-44b3-b15d-453a5efe923a None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.131052 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8812718-8daa-44b3-b15d-453a5efe923a None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.131536 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8812718-8daa-44b3-b15d-453a5efe923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.137524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:43.152115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-a8812718-8daa-44b3-b15d-453a5efe923a None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:43.153758 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-a8812718-8daa-44b3-b15d-453a5efe923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:43.228852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 296/595] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:43.230044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5c18c-e411-430f-b901-2a5232a867bf None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.230333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5c18c-e411-430f-b901-2a5232a867bf None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.230606 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5c18c-e411-430f-b901-2a5232a867bf None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.231831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 297/596] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:43.232587 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5c18c-e411-430f-b901-2a5232a867bf None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:43.246284 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 300/597] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:43.247547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a788-511f-4b27-8125-f5450f961bbb None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.247828 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a788-511f-4b27-8125-f5450f961bbb None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.248097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a788-511f-4b27-8125-f5450f961bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.267693 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-bc08a788-511f-4b27-8125-f5450f961bbb None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:43.268872 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-bc08a788-511f-4b27-8125-f5450f961bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:43.341208 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 301/598] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:43.341208 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08a788-511f-4b27-8125-f5450f961bbb None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:43.352662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5c18c-e411-430f-b901-2a5232a867bf None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:43.362363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:43.378298 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:43.400608 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f0b4e-5d12-498b-b756-6236c7ccfa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:43.401384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f0b4e-5d12-498b-b756-6236c7ccfa49 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.406502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f0b4e-5d12-498b-b756-6236c7ccfa49 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.406502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f0b4e-5d12-498b-b756-6236c7ccfa49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.417361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f0b4e-5d12-498b-b756-6236c7ccfa49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-0d8f0b4e-5d12-498b-b756-6236c7ccfa49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:43.423641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:43.430342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:43.431171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 298/599] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:43.434202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f0b4e-5d12-498b-b756-6236c7ccfa49 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:43.469024 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08a788-511f-4b27-8125-f5450f961bbb None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:43.518938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29a3bc-dc2b-4e99-a65d-6cb46f178c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:43.519570 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29a3bc-dc2b-4e99-a65d-6cb46f178c55 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.519812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29a3bc-dc2b-4e99-a65d-6cb46f178c55 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.520024 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29a3bc-dc2b-4e99-a65d-6cb46f178c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.535098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29a3bc-dc2b-4e99-a65d-6cb46f178c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:43.536567 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29a3bc-dc2b-4e99-a65d-6cb46f178c55 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:43.551107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f0b4e-5d12-498b-b756-6236c7ccfa49 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-8b29a3bc-dc2b-4e99-a65d-6cb46f178c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:43.556696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:43.557697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:43.558586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:43.558586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:43.558586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:43.558586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 302/600] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:43.558586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29a3bc-dc2b-4e99-a65d-6cb46f178c55 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:43.593862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d43ebb-fcd3-4b20-9d28-a707285d9e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:43.594460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43ebb-fcd3-4b20-9d28-a707285d9e20 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.594740 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43ebb-fcd3-4b20-9d28-a707285d9e20 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.595013 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43ebb-fcd3-4b20-9d28-a707285d9e20 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.595687 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43ebb-fcd3-4b20-9d28-a707285d9e20 None admin] RBAC: Adding query filter params (name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:43.595968 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43ebb-fcd3-4b20-9d28-a707285d9e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:43.597365 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43ebb-fcd3-4b20-9d28-a707285d9e20 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:43.609334 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 299/601] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:43.609334 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d43ebb-fcd3-4b20-9d28-a707285d9e20 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:43.641358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:43.656782 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:43.669375 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29a3bc-dc2b-4e99-a65d-6cb46f178c55 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:43.703239 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046281ed-f802-480b-87e9-1bf61a12d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:43.710210 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046281ed-f802-480b-87e9-1bf61a12d5a2 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.710210 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046281ed-f802-480b-87e9-1bf61a12d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.710210 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046281ed-f802-480b-87e9-1bf61a12d5a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.714963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d43ebb-fcd3-4b20-9d28-a707285d9e20 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:43.715307 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046281ed-f802-480b-87e9-1bf61a12d5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-046281ed-f802-480b-87e9-1bf61a12d5a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:43.720180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:43.721097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:43.721965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 303/602] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:43.722708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046281ed-f802-480b-87e9-1bf61a12d5a2 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:43.751770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432a00-62ce-4e56-b590-9d4b2e2a6d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:43.752357 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432a00-62ce-4e56-b590-9d4b2e2a6d2a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.752628 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432a00-62ce-4e56-b590-9d4b2e2a6d2a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.752899 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432a00-62ce-4e56-b590-9d4b2e2a6d2a None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.753553 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432a00-62ce-4e56-b590-9d4b2e2a6d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:43.753853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432a00-62ce-4e56-b590-9d4b2e2a6d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:43.755192 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432a00-62ce-4e56-b590-9d4b2e2a6d2a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:43.767867 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 300/603] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:43.768643 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432a00-62ce-4e56-b590-9d4b2e2a6d2a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:43.826979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046281ed-f802-480b-87e9-1bf61a12d5a2 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:43.857593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:43.859964 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d7652-9e4a-4498-b099-48fcdf9d45b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:43.860591 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d7652-9e4a-4498-b099-48fcdf9d45b5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.860868 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d7652-9e4a-4498-b099-48fcdf9d45b5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.861139 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d7652-9e4a-4498-b099-48fcdf9d45b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.869718 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432a00-62ce-4e56-b590-9d4b2e2a6d2a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:43.872713 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d7652-9e4a-4498-b099-48fcdf9d45b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:43.874203 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d7652-9e4a-4498-b099-48fcdf9d45b5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:43.882195 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-646d7652-9e4a-4498-b099-48fcdf9d45b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:43.888629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:43.889736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:43.890615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:43.890615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:43.890615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:43.890615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 304/604] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:43.890615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d7652-9e4a-4498-b099-48fcdf9d45b5 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:43.909002 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208301e-c842-40e5-8dbf-8162458e9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:43.909769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208301e-c842-40e5-8dbf-8162458e9534 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:43.910042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208301e-c842-40e5-8dbf-8162458e9534 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:43.910309 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208301e-c842-40e5-8dbf-8162458e9534 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:43.921468 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208301e-c842-40e5-8dbf-8162458e9534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-c208301e-c842-40e5-8dbf-8162458e9534 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:43.926145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:43.927201 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 301/605] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:43.930128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208301e-c842-40e5-8dbf-8162458e9534 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:43.994903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d7652-9e4a-4498-b099-48fcdf9d45b5 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.027803 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f17cc-06eb-4d19-b7a0-ca5a57f730e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.028403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f17cc-06eb-4d19-b7a0-ca5a57f730e9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.028677 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f17cc-06eb-4d19-b7a0-ca5a57f730e9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.028944 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f17cc-06eb-4d19-b7a0-ca5a57f730e9 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.029620 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f17cc-06eb-4d19-b7a0-ca5a57f730e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:44.029922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f17cc-06eb-4d19-b7a0-ca5a57f730e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.031290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f17cc-06eb-4d19-b7a0-ca5a57f730e9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.032530 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208301e-c842-40e5-8dbf-8162458e9534 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.043453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 305/606] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:44.043453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f17cc-06eb-4d19-b7a0-ca5a57f730e9 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.065544 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b49f5-2e2d-42f4-b4f6-102ddbd74014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.066093 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b49f5-2e2d-42f4-b4f6-102ddbd74014 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.066376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b49f5-2e2d-42f4-b4f6-102ddbd74014 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.066668 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b49f5-2e2d-42f4-b4f6-102ddbd74014 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.074239 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b49f5-2e2d-42f4-b4f6-102ddbd74014 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.075675 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b49f5-2e2d-42f4-b4f6-102ddbd74014 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-d37b49f5-2e2d-42f4-b4f6-102ddbd74014 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:44.087559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:44.088593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:44.089566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:44.089566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:44.089566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:44.089566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:44.089566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:44.089566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:44.089566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:44.089566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:44.089566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 302/607] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:44.090034 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b49f5-2e2d-42f4-b4f6-102ddbd74014 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.103019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:44.105636 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:44.142378 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f17cc-06eb-4d19-b7a0-ca5a57f730e9 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.175689 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712b8b-18b3-4612-bd1c-682fdbb1e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.176285 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712b8b-18b3-4612-bd1c-682fdbb1e290 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.176560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712b8b-18b3-4612-bd1c-682fdbb1e290 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.176827 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712b8b-18b3-4612-bd1c-682fdbb1e290 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.177495 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712b8b-18b3-4612-bd1c-682fdbb1e290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:44.178116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712b8b-18b3-4612-bd1c-682fdbb1e290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.179149 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712b8b-18b3-4612-bd1c-682fdbb1e290 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.190310 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b49f5-2e2d-42f4-b4f6-102ddbd74014 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.191531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 306/608] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:44.192304 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712b8b-18b3-4612-bd1c-682fdbb1e290 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.224194 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702646-ce49-4baa-a317-8b9c9568ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.224791 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702646-ce49-4baa-a317-8b9c9568ffe8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.225068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702646-ce49-4baa-a317-8b9c9568ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.225391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702646-ce49-4baa-a317-8b9c9568ffe8 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.226042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97702646-ce49-4baa-a317-8b9c9568ffe8 None admin] RBAC: Adding query filter params (name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:44.226954 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97702646-ce49-4baa-a317-8b9c9568ffe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.228316 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97702646-ce49-4baa-a317-8b9c9568ffe8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.236294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 303/609] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:44.237071 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702646-ce49-4baa-a317-8b9c9568ffe8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.288381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712b8b-18b3-4612-bd1c-682fdbb1e290 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.307347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:44.313073 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:44.325111 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6a87d-95ef-43bf-863d-4968d0a4ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.325702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6a87d-95ef-43bf-863d-4968d0a4ff76 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.325977 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6a87d-95ef-43bf-863d-4968d0a4ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.326247 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6a87d-95ef-43bf-863d-4968d0a4ff76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.336380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6a87d-95ef-43bf-863d-4968d0a4ff76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.337769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702646-ce49-4baa-a317-8b9c9568ffe8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.338222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6a87d-95ef-43bf-863d-4968d0a4ff76 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-daf6a87d-95ef-43bf-863d-4968d0a4ff76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:44.353174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:44.354276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:44.355152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:44.355152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:44.355152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:44.355152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 307/610] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:44.355152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6a87d-95ef-43bf-863d-4968d0a4ff76 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.375124 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c832d9-6511-4062-aad8-56cc882d025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.375713 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c832d9-6511-4062-aad8-56cc882d025e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.375984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c832d9-6511-4062-aad8-56cc882d025e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.376251 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c832d9-6511-4062-aad8-56cc882d025e None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.376926 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c832d9-6511-4062-aad8-56cc882d025e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:44.377254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c832d9-6511-4062-aad8-56cc882d025e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.378666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c832d9-6511-4062-aad8-56cc882d025e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.391683 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 304/611] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:44.393330 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c832d9-6511-4062-aad8-56cc882d025e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.457720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6a87d-95ef-43bf-863d-4968d0a4ff76 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.490822 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c832d9-6511-4062-aad8-56cc882d025e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.491457 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22099d-c7e8-4de5-8155-06d4c6bf16aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.492545 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22099d-c7e8-4de5-8155-06d4c6bf16aa None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.492825 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22099d-c7e8-4de5-8155-06d4c6bf16aa None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.493087 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22099d-c7e8-4de5-8155-06d4c6bf16aa None admin] PATH_INFO: `/v3/users/glance` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.500434 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22099d-c7e8-4de5-8155-06d4c6bf16aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.501906 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22099d-c7e8-4de5-8155-06d4c6bf16aa None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-8c22099d-c7e8-4de5-8155-06d4c6bf16aa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:44.513465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:44.514574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 308/612] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:44.515699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22099d-c7e8-4de5-8155-06d4c6bf16aa None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.522717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:44.528718 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fec656-b562-49ab-b738-0af081084a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.530624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fec656-b562-49ab-b738-0af081084a76 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.530624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fec656-b562-49ab-b738-0af081084a76 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.530624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fec656-b562-49ab-b738-0af081084a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.540193 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fec656-b562-49ab-b738-0af081084a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.541668 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fec656-b562-49ab-b738-0af081084a76 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.548021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-52fec656-b562-49ab-b738-0af081084a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:44.556871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:44.559872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:44.560756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:44.560756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:44.560756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:44.560756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 305/613] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:44.560756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fec656-b562-49ab-b738-0af081084a76 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.615067 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22099d-c7e8-4de5-8155-06d4c6bf16aa None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.648910 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b794ac-8cbe-4d64-bd12-67a793ca9386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.649695 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b794ac-8cbe-4d64-bd12-67a793ca9386 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.649973 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b794ac-8cbe-4d64-bd12-67a793ca9386 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.650243 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b794ac-8cbe-4d64-bd12-67a793ca9386 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.650875 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b794ac-8cbe-4d64-bd12-67a793ca9386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:44.651176 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b794ac-8cbe-4d64-bd12-67a793ca9386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.652541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b794ac-8cbe-4d64-bd12-67a793ca9386 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.658508 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fec656-b562-49ab-b738-0af081084a76 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.663433 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 309/614] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:44.664973 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b794ac-8cbe-4d64-bd12-67a793ca9386 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.696313 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f73eae-b3fc-4be0-b28b-47cf4b334fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.696916 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f73eae-b3fc-4be0-b28b-47cf4b334fed None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.697228 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f73eae-b3fc-4be0-b28b-47cf4b334fed None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.697504 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f73eae-b3fc-4be0-b28b-47cf4b334fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.698231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f73eae-b3fc-4be0-b28b-47cf4b334fed None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=9674e78b7a6b41eb8a00aefff4cd22c1) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:44.698541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f73eae-b3fc-4be0-b28b-47cf4b334fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.699970 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f73eae-b3fc-4be0-b28b-47cf4b334fed None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.705687 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 306/615] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/role_assignments?user.id=9674e78b7a6b41eb8a00aefff4cd22c1&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:44.706460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f73eae-b3fc-4be0-b28b-47cf4b334fed None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.760900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:44.792999 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:44.801315 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b794ac-8cbe-4d64-bd12-67a793ca9386 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.840700 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f73eae-b3fc-4be0-b28b-47cf4b334fed None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:44.847199 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82c0a0-1975-4b92-8dc1-6ec746076c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.847820 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82c0a0-1975-4b92-8dc1-6ec746076c56 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.848111 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82c0a0-1975-4b92-8dc1-6ec746076c56 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.848381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82c0a0-1975-4b92-8dc1-6ec746076c56 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.849108 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82c0a0-1975-4b92-8dc1-6ec746076c56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:44.849463 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82c0a0-1975-4b92-8dc1-6ec746076c56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.850927 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82c0a0-1975-4b92-8dc1-6ec746076c56 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.871653 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 310/616] 10.222.0.52 () {56 vars in 1137 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:44.872442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82c0a0-1975-4b92-8dc1-6ec746076c56 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.891160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4516ec-9cb1-4149-be41-6a61bc925e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:44.891775 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4516ec-9cb1-4149-be41-6a61bc925e20 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:44.892052 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4516ec-9cb1-4149-be41-6a61bc925e20 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:44.892322 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4516ec-9cb1-4149-be41-6a61bc925e20 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:44.892963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4516ec-9cb1-4149-be41-6a61bc925e20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:44.893299 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4516ec-9cb1-4149-be41-6a61bc925e20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:44.894787 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4516ec-9cb1-4149-be41-6a61bc925e20 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:44.913001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 307/617] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:44.913001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4516ec-9cb1-4149-be41-6a61bc925e20 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:44.996280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82c0a0-1975-4b92-8dc1-6ec746076c56 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:45.033325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc60a43-e166-430b-8c4c-4b859e5e10eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:45.033575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4516ec-9cb1-4149-be41-6a61bc925e20 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:45.034073 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc60a43-e166-430b-8c4c-4b859e5e10eb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:45.034350 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc60a43-e166-430b-8c4c-4b859e5e10eb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:45.034621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc60a43-e166-430b-8c4c-4b859e5e10eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:45.041549 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:45.043133 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc60a43-e166-430b-8c4c-4b859e5e10eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:45.044579 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc60a43-e166-430b-8c4c-4b859e5e10eb None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-bfc60a43-e166-430b-8c4c-4b859e5e10eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:45.056987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:45.057965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 20:38:45.059222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:45.061308 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 311/618] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:45.062337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc60a43-e166-430b-8c4c-4b859e5e10eb None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:45.071334 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221dafb-31ff-499a-931f-8e226e89fc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:45.071939 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221dafb-31ff-499a-931f-8e226e89fc23 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:45.072219 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221dafb-31ff-499a-931f-8e226e89fc23 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:45.072495 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221dafb-31ff-499a-931f-8e226e89fc23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:45.079094 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:45.146105 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221dafb-31ff-499a-931f-8e226e89fc23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:45.147593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221dafb-31ff-499a-931f-8e226e89fc23 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:45.174342 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc60a43-e166-430b-8c4c-4b859e5e10eb None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:45.209952 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8a6c2-4255-4f48-b2e6-dde8d4219c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:45.211268 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a6c2-4255-4f48-b2e6-dde8d4219c9a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:45.211695 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a6c2-4255-4f48-b2e6-dde8d4219c9a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:45.211695 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a6c2-4255-4f48-b2e6-dde8d4219c9a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:45.220457 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8a6c2-4255-4f48-b2e6-dde8d4219c9a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:45.222926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8a6c2-4255-4f48-b2e6-dde8d4219c9a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-b8e8a6c2-4255-4f48-b2e6-dde8d4219c9a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:45.235623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:45.236703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 312/619] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:45.238030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8a6c2-4255-4f48-b2e6-dde8d4219c9a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:45.270510 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 308/620] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:45.271717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221dafb-31ff-499a-931f-8e226e89fc23 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:45.282926 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:45.312254 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:45.343042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8a6c2-4255-4f48-b2e6-dde8d4219c9a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:45.381801 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df0282-e59c-479a-8aed-9c9dba4f3261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:45.383102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df0282-e59c-479a-8aed-9c9dba4f3261 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:45.383377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df0282-e59c-479a-8aed-9c9dba4f3261 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:45.383698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df0282-e59c-479a-8aed-9c9dba4f3261 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:45.384423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df0282-e59c-479a-8aed-9c9dba4f3261 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:45.384753 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df0282-e59c-479a-8aed-9c9dba4f3261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:45.386012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221dafb-31ff-499a-931f-8e226e89fc23 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:45.386179 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df0282-e59c-479a-8aed-9c9dba4f3261 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:45.404063 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 313/621] 10.222.0.52 () {56 vars in 1139 bytes} [Sat Sep 17 20:38:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:45.404811 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df0282-e59c-479a-8aed-9c9dba4f3261 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:45.426616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cca4c-acc2-41fb-8554-cd9a1045733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:45.427213 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cca4c-acc2-41fb-8554-cd9a1045733e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:45.427486 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cca4c-acc2-41fb-8554-cd9a1045733e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:45.427754 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cca4c-acc2-41fb-8554-cd9a1045733e None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:45.428469 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cca4c-acc2-41fb-8554-cd9a1045733e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:45.428787 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cca4c-acc2-41fb-8554-cd9a1045733e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:45.430899 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cca4c-acc2-41fb-8554-cd9a1045733e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:45.448520 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 309/622] 10.222.0.52 () {56 vars in 1137 bytes} [Sat Sep 17 20:38:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:45.449300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cca4c-acc2-41fb-8554-cd9a1045733e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:45.515176 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df0282-e59c-479a-8aed-9c9dba4f3261 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:45.520625 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:45.546834 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:45.553663 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad731ce-cba9-48d4-b20a-c53b9d7a7fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:45.554630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad731ce-cba9-48d4-b20a-c53b9d7a7fb7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:45.554906 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad731ce-cba9-48d4-b20a-c53b9d7a7fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:45.555320 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad731ce-cba9-48d4-b20a-c53b9d7a7fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:45.560332 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cca4c-acc2-41fb-8554-cd9a1045733e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:45.565719 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad731ce-cba9-48d4-b20a-c53b9d7a7fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:45.567297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad731ce-cba9-48d4-b20a-c53b9d7a7fb7 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-aad731ce-cba9-48d4-b20a-c53b9d7a7fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:45.582718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:45.583815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:45.584882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:45.584882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:45.584882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:45.588507 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 314/623] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:45.589402 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad731ce-cba9-48d4-b20a-c53b9d7a7fb7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:45.601080 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154f5c-f9fa-45fb-9412-03541a18f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:45.602574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154f5c-f9fa-45fb-9412-03541a18f5ae None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:45.602917 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154f5c-f9fa-45fb-9412-03541a18f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:45.603254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154f5c-f9fa-45fb-9412-03541a18f5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:45.674165 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc154f5c-f9fa-45fb-9412-03541a18f5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:45.675831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc154f5c-f9fa-45fb-9412-03541a18f5ae None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:45.698701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad731ce-cba9-48d4-b20a-c53b9d7a7fb7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:45.733782 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd562f04-5f62-423b-b2c3-29d3f51088f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:45.734383 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd562f04-5f62-423b-b2c3-29d3f51088f0 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:45.734660 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd562f04-5f62-423b-b2c3-29d3f51088f0 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:45.734931 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd562f04-5f62-423b-b2c3-29d3f51088f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:45.740164 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:45.779535 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 310/624] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:45.780169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154f5c-f9fa-45fb-9412-03541a18f5ae None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:45.790464 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:45.814269 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd562f04-5f62-423b-b2c3-29d3f51088f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:45.815917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd562f04-5f62-423b-b2c3-29d3f51088f0 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:45.890944 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154f5c-f9fa-45fb-9412-03541a18f5ae None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:45.920171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 315/625] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:45.921089 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd562f04-5f62-423b-b2c3-29d3f51088f0 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:45.932591 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589379b-0e16-4573-9376-6dd1e5cb6933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:45.933115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589379b-0e16-4573-9376-6dd1e5cb6933 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:45.933423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589379b-0e16-4573-9376-6dd1e5cb6933 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:45.933688 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589379b-0e16-4573-9376-6dd1e5cb6933 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:45.934324 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589379b-0e16-4573-9376-6dd1e5cb6933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:45.934623 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589379b-0e16-4573-9376-6dd1e5cb6933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:45.935996 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589379b-0e16-4573-9376-6dd1e5cb6933 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:45.947835 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 311/626] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:45.948657 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589379b-0e16-4573-9376-6dd1e5cb6933 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:45.976938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:46.015365 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:46.034193 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd562f04-5f62-423b-b2c3-29d3f51088f0 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.054482 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589379b-0e16-4573-9376-6dd1e5cb6933 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.075319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caaac1-bfd9-4881-bb66-8d22e5b2ba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.076102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caaac1-bfd9-4881-bb66-8d22e5b2ba46 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.076308 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caaac1-bfd9-4881-bb66-8d22e5b2ba46 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.076576 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caaac1-bfd9-4881-bb66-8d22e5b2ba46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.087366 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caaac1-bfd9-4881-bb66-8d22e5b2ba46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.088718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caaac1-bfd9-4881-bb66-8d22e5b2ba46 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.091703 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924c45-764a-4bf2-b4ed-a22ff3fc58ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.092329 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924c45-764a-4bf2-b4ed-a22ff3fc58ff None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.092606 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924c45-764a-4bf2-b4ed-a22ff3fc58ff None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.092887 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924c45-764a-4bf2-b4ed-a22ff3fc58ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-f5caaac1-bfd9-4881-bb66-8d22e5b2ba46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:46.103697 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:46.104705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:46.105621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:46.105621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:46.105621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:46.105621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 316/627] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:46.105621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caaac1-bfd9-4881-bb66-8d22e5b2ba46 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:46.110932 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924c45-764a-4bf2-b4ed-a22ff3fc58ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.112406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924c45-764a-4bf2-b4ed-a22ff3fc58ff None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-2d924c45-764a-4bf2-b4ed-a22ff3fc58ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:46.128229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:46.129249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:46.130160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:46.130160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:46.130160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:46.130160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 312/628] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:46.130160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924c45-764a-4bf2-b4ed-a22ff3fc58ff None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:46.207257 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:46.223826 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caaac1-bfd9-4881-bb66-8d22e5b2ba46 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.232035 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924c45-764a-4bf2-b4ed-a22ff3fc58ff None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.260873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2df34-88fa-42f2-a330-c283f4d40012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.261540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2df34-88fa-42f2-a330-c283f4d40012 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.261821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2df34-88fa-42f2-a330-c283f4d40012 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.262091 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2df34-88fa-42f2-a330-c283f4d40012 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.263976 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:46.269061 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24c199-3c81-4afb-b511-c5ed49de35dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.269305 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2df34-88fa-42f2-a330-c283f4d40012 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.269684 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24c199-3c81-4afb-b511-c5ed49de35dc None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.269956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24c199-3c81-4afb-b511-c5ed49de35dc None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.270229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24c199-3c81-4afb-b511-c5ed49de35dc None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.270619 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2df34-88fa-42f2-a330-c283f4d40012 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.270929 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24c199-3c81-4afb-b511-c5ed49de35dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:46.271233 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24c199-3c81-4afb-b511-c5ed49de35dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.272559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24c199-3c81-4afb-b511-c5ed49de35dc None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-0af2df34-88fa-42f2-a330-c283f4d40012 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:46.282892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:46.283775 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:46.293848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:46.293848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:46.293848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:46.293848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:46.293848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:46.293848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:46.293848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:46.293848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:46.293848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 317/629] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:46.294338 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 313/630] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:46.294411 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2df34-88fa-42f2-a330-c283f4d40012 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:46.294481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24c199-3c81-4afb-b511-c5ed49de35dc None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:46.393408 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2df34-88fa-42f2-a330-c283f4d40012 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.411711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24c199-3c81-4afb-b511-c5ed49de35dc None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c5973-cfbb-4b14-8739-f61e97ce46f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.433269 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c5973-cfbb-4b14-8739-f61e97ce46f9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.433754 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c5973-cfbb-4b14-8739-f61e97ce46f9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.434119 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c5973-cfbb-4b14-8739-f61e97ce46f9 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.434848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c5973-cfbb-4b14-8739-f61e97ce46f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:46.435154 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c5973-cfbb-4b14-8739-f61e97ce46f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.436737 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c5973-cfbb-4b14-8739-f61e97ce46f9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.447012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e14f0-7566-41a8-a40d-19044ec43779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.447613 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e14f0-7566-41a8-a40d-19044ec43779 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.447889 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e14f0-7566-41a8-a40d-19044ec43779 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.448158 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e14f0-7566-41a8-a40d-19044ec43779 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.448976 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e14f0-7566-41a8-a40d-19044ec43779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:46.449320 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e14f0-7566-41a8-a40d-19044ec43779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.450742 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e14f0-7566-41a8-a40d-19044ec43779 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.451704 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 318/631] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:46.452838 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c5973-cfbb-4b14-8739-f61e97ce46f9 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:46.457986 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:46.468992 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 314/632] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:46.470214 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e14f0-7566-41a8-a40d-19044ec43779 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:46.519111 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:46.570673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c5973-cfbb-4b14-8739-f61e97ce46f9 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.586320 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e14f0-7566-41a8-a40d-19044ec43779 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.615740 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78842a8a-c3ab-46f9-9562-8c3aaf44dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.617337 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78842a8a-c3ab-46f9-9562-8c3aaf44dd96 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.618342 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78842a8a-c3ab-46f9-9562-8c3aaf44dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.619064 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78842a8a-c3ab-46f9-9562-8c3aaf44dd96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.623012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa95942-5766-496d-a9a8-b8969721f724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.623632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa95942-5766-496d-a9a8-b8969721f724 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.623908 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa95942-5766-496d-a9a8-b8969721f724 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.624176 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa95942-5766-496d-a9a8-b8969721f724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.628066 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78842a8a-c3ab-46f9-9562-8c3aaf44dd96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.629729 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78842a8a-c3ab-46f9-9562-8c3aaf44dd96 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.630881 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa95942-5766-496d-a9a8-b8969721f724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.632293 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa95942-5766-496d-a9a8-b8969721f724 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-78842a8a-c3ab-46f9-9562-8c3aaf44dd96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:46.643547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:46.644413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:46.645311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:46.645311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:46.645311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:46.645311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:46.645311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:46.645311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:46.645311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:46.645311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-1fa95942-5766-496d-a9a8-b8969721f724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:46.645729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:46.647055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 315/633] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:46.648173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa95942-5766-496d-a9a8-b8969721f724 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:46.650737 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 319/634] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:46.651741 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78842a8a-c3ab-46f9-9562-8c3aaf44dd96 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:46.706914 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:46.756210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa95942-5766-496d-a9a8-b8969721f724 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.767746 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78842a8a-c3ab-46f9-9562-8c3aaf44dd96 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:46.784464 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:46.805430 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a800747-1c64-4f87-8ba9-b462a334faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.806391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a800747-1c64-4f87-8ba9-b462a334faf5 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.806779 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a800747-1c64-4f87-8ba9-b462a334faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.807016 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a800747-1c64-4f87-8ba9-b462a334faf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.807773 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a800747-1c64-4f87-8ba9-b462a334faf5 None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=d8200d2f30fa47dc9799dfa26a81109a) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:46.808084 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a800747-1c64-4f87-8ba9-b462a334faf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.810087 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a800747-1c64-4f87-8ba9-b462a334faf5 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.813985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593232a3-a3c1-4ac8-814c-5abca51525cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:46.814868 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593232a3-a3c1-4ac8-814c-5abca51525cb None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:46.814868 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593232a3-a3c1-4ac8-814c-5abca51525cb None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:46.815149 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593232a3-a3c1-4ac8-814c-5abca51525cb None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:46.815949 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593232a3-a3c1-4ac8-814c-5abca51525cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:46.816272 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593232a3-a3c1-4ac8-814c-5abca51525cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:46.817787 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593232a3-a3c1-4ac8-814c-5abca51525cb None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:46.829640 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 316/635] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/role_assignments?user.id=d8200d2f30fa47dc9799dfa26a81109a&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:46.829640 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a800747-1c64-4f87-8ba9-b462a334faf5 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:46.869892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 320/636] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:46.873191 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593232a3-a3c1-4ac8-814c-5abca51525cb None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:47.037738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a800747-1c64-4f87-8ba9-b462a334faf5 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:47.072562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593232a3-a3c1-4ac8-814c-5abca51525cb None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:47.073744 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:47.087835 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e48e-f6b4-4783-b163-f79fce01587e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:47.088488 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e48e-f6b4-4783-b163-f79fce01587e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:47.088759 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e48e-f6b4-4783-b163-f79fce01587e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:47.089025 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e48e-f6b4-4783-b163-f79fce01587e None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:47.089761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e48e-f6b4-4783-b163-f79fce01587e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:47.090054 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e48e-f6b4-4783-b163-f79fce01587e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:47.091487 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e48e-f6b4-4783-b163-f79fce01587e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:47.105992 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 317/637] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:47.111673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e48e-f6b4-4783-b163-f79fce01587e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:47.116202 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a23c3-9b94-4a3b-9f76-972af4fd3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:47.117422 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a23c3-9b94-4a3b-9f76-972af4fd3b9c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:47.117731 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a23c3-9b94-4a3b-9f76-972af4fd3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:47.117993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a23c3-9b94-4a3b-9f76-972af4fd3b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:47.118705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a23c3-9b94-4a3b-9f76-972af4fd3b9c None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=681cab6042a3486087c55058843deeb2) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:47.119005 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a23c3-9b94-4a3b-9f76-972af4fd3b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:47.120456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a23c3-9b94-4a3b-9f76-972af4fd3b9c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:47.128442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 321/638] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:46 2022] GET /identity/v3/role_assignments?user.id=681cab6042a3486087c55058843deeb2&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:47.237928 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e48e-f6b4-4783-b163-f79fce01587e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:47.255857 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc7c8-abb0-4070-bcac-7b6c4fa5cba9 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:47.256129 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc7c8-abb0-4070-bcac-7b6c4fa5cba9 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:47.256404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc7c8-abb0-4070-bcac-7b6c4fa5cba9 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:47.258630 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 322/639] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:47.264131 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e330-ba69-4fa9-a50a-8ce28535ed45 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:47.264411 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e330-ba69-4fa9-a50a-8ce28535ed45 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:47.264690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e330-ba69-4fa9-a50a-8ce28535ed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:47.280773 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73425ddd-f2f9-4536-8bb5-ba0fb1d1c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:47.281424 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73425ddd-f2f9-4536-8bb5-ba0fb1d1c828 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:47.281702 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73425ddd-f2f9-4536-8bb5-ba0fb1d1c828 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:47.281972 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73425ddd-f2f9-4536-8bb5-ba0fb1d1c828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:47.282777 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73425ddd-f2f9-4536-8bb5-ba0fb1d1c828 None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=ca8186a27e64434f92b8bba23558cf8a) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:47.283151 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73425ddd-f2f9-4536-8bb5-ba0fb1d1c828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:47.284673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73425ddd-f2f9-4536-8bb5-ba0fb1d1c828 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:47.288131 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-3b61e330-ba69-4fa9-a50a-8ce28535ed45 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:47.290285 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-3b61e330-ba69-4fa9-a50a-8ce28535ed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:47.293621 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 318/640] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:47 2022] GET /identity/v3/role_assignments?user.id=ca8186a27e64434f92b8bba23558cf8a&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:47.326762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:47.371499 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 323/641] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 20:38:47.711696 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73425ddd-f2f9-4536-8bb5-ba0fb1d1c828 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:47.762138 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:47.825515 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73425ddd-f2f9-4536-8bb5-ba0fb1d1c828 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:47.860965 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1e62f-60e1-4513-a8db-8927cbbd5b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:47.861626 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1e62f-60e1-4513-a8db-8927cbbd5b45 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:47.861904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1e62f-60e1-4513-a8db-8927cbbd5b45 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:47.862177 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1e62f-60e1-4513-a8db-8927cbbd5b45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:47.873446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1e62f-60e1-4513-a8db-8927cbbd5b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-eae1e62f-60e1-4513-a8db-8927cbbd5b45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:47.878685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:47.879691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:47.880573 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 319/642] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:38:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:47.886190 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e330-ba69-4fa9-a50a-8ce28535ed45 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:47.989815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e330-ba69-4fa9-a50a-8ce28535ed45 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:48.028185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff22d1-a34a-45b4-8d3b-6d5b9c97083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:48.028792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff22d1-a34a-45b4-8d3b-6d5b9c97083f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:48.029070 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff22d1-a34a-45b4-8d3b-6d5b9c97083f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:48.029375 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff22d1-a34a-45b4-8d3b-6d5b9c97083f None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:48.030036 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff22d1-a34a-45b4-8d3b-6d5b9c97083f None admin] RBAC: Adding query filter params (name=admin) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:48.030336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff22d1-a34a-45b4-8d3b-6d5b9c97083f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:48.031833 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff22d1-a34a-45b4-8d3b-6d5b9c97083f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:48.041211 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 324/643] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:48.046534 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1e62f-60e1-4513-a8db-8927cbbd5b45 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:48.164374 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1e62f-60e1-4513-a8db-8927cbbd5b45 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:48.167111 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:48.200058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b5cb9-92f3-4f3e-b345-a0d3d3906a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:48.200690 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b5cb9-92f3-4f3e-b345-a0d3d3906a6e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:48.200967 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b5cb9-92f3-4f3e-b345-a0d3d3906a6e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:48.201281 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b5cb9-92f3-4f3e-b345-a0d3d3906a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:48.212868 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b5cb9-92f3-4f3e-b345-a0d3d3906a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:48.214428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b5cb9-92f3-4f3e-b345-a0d3d3906a6e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-305b5cb9-92f3-4f3e-b345-a0d3d3906a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:48.230615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:48.231574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:48.232446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:48.232446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:48.232446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:48.232446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 320/644] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:48.237508 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff22d1-a34a-45b4-8d3b-6d5b9c97083f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:48.268283 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:48.345193 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff22d1-a34a-45b4-8d3b-6d5b9c97083f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:48.383864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b67fa-1e5a-4947-974e-537995a1d7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:48.384497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b67fa-1e5a-4947-974e-537995a1d7af None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:48.384779 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b67fa-1e5a-4947-974e-537995a1d7af None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:48.385056 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b67fa-1e5a-4947-974e-537995a1d7af None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:48.385710 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b67fa-1e5a-4947-974e-537995a1d7af None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:48.386013 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b67fa-1e5a-4947-974e-537995a1d7af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:48.387371 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b67fa-1e5a-4947-974e-537995a1d7af None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:48.399980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 325/645] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:48.410269 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b5cb9-92f3-4f3e-b345-a0d3d3906a6e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:48.518537 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b5cb9-92f3-4f3e-b345-a0d3d3906a6e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:48.555863 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7f9ce-8a98-493c-8fdc-78d35dae358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:48.556728 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7f9ce-8a98-493c-8fdc-78d35dae358f None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:48.557144 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7f9ce-8a98-493c-8fdc-78d35dae358f None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:48.557610 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7f9ce-8a98-493c-8fdc-78d35dae358f None admin] PATH_INFO: `/v3/users/nova` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:48.565615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7f9ce-8a98-493c-8fdc-78d35dae358f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:48.567237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7f9ce-8a98-493c-8fdc-78d35dae358f None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-c1b7f9ce-8a98-493c-8fdc-78d35dae358f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:48.583260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:48.584198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:48.585107 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 321/646] 10.222.0.52 () {56 vars in 1093 bytes} [Sat Sep 17 20:38:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:48.592585 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b67fa-1e5a-4947-974e-537995a1d7af None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:48.687855 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:48.698838 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b67fa-1e5a-4947-974e-537995a1d7af None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:48.734617 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a0f2b-fa2a-4bf0-bf50-26f3dfd4ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:48.735228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a0f2b-fa2a-4bf0-bf50-26f3dfd4ad3d None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:48.735502 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a0f2b-fa2a-4bf0-bf50-26f3dfd4ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:48.735837 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a0f2b-fa2a-4bf0-bf50-26f3dfd4ad3d None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:48.736622 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a0f2b-fa2a-4bf0-bf50-26f3dfd4ad3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:48.736931 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a0f2b-fa2a-4bf0-bf50-26f3dfd4ad3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:48.738509 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a0f2b-fa2a-4bf0-bf50-26f3dfd4ad3d None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:48.758531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 326/647] 10.222.0.52 () {56 vars in 1133 bytes} [Sat Sep 17 20:38:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:48.766247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7f9ce-8a98-493c-8fdc-78d35dae358f None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:48.785632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:48.887359 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7f9ce-8a98-493c-8fdc-78d35dae358f None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:48.923276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b6c16-158c-41e7-bf0e-99c457866918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:48.924276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6c16-158c-41e7-bf0e-99c457866918 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:48.924770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6c16-158c-41e7-bf0e-99c457866918 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:48.925292 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6c16-158c-41e7-bf0e-99c457866918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:48.996790 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b6c16-158c-41e7-bf0e-99c457866918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:48.998716 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b6c16-158c-41e7-bf0e-99c457866918 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:49.016543 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:49.107727 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 322/648] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 20:38:49.113192 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a0f2b-fa2a-4bf0-bf50-26f3dfd4ad3d None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:49.215957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a0f2b-fa2a-4bf0-bf50-26f3dfd4ad3d None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:49.251999 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e3692-06e8-4813-8a2b-966ae2e0ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:49.252629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e3692-06e8-4813-8a2b-966ae2e0ce2a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:49.252907 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e3692-06e8-4813-8a2b-966ae2e0ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:49.253194 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e3692-06e8-4813-8a2b-966ae2e0ce2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:49.264590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e3692-06e8-4813-8a2b-966ae2e0ce2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:49.266078 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e3692-06e8-4813-8a2b-966ae2e0ce2a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-221e3692-06e8-4813-8a2b-966ae2e0ce2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:49.281724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:49.282686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:49.283565 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:49.283565 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:49.283565 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:49.283565 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 327/649] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:49.285468 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:49.288488 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b6c16-158c-41e7-bf0e-99c457866918 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:49.398836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b6c16-158c-41e7-bf0e-99c457866918 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:49.416680 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:49.439582 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59617a-9e34-40d3-a59b-4bfcfa55dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:49.440188 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59617a-9e34-40d3-a59b-4bfcfa55dac1 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:49.440467 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59617a-9e34-40d3-a59b-4bfcfa55dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:49.440741 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59617a-9e34-40d3-a59b-4bfcfa55dac1 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:49.441418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59617a-9e34-40d3-a59b-4bfcfa55dac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:49.441721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59617a-9e34-40d3-a59b-4bfcfa55dac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:49.443355 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59617a-9e34-40d3-a59b-4bfcfa55dac1 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:49.460602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 323/650] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:49.461967 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e3692-06e8-4813-8a2b-966ae2e0ce2a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:49.501503 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fa24b-223e-4545-95df-289b648a7458 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:49.501818 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fa24b-223e-4545-95df-289b648a7458 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:49.502059 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fa24b-223e-4545-95df-289b648a7458 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:49.503636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 324/651] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:49.508750 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0296f-27b6-4a72-94f6-488473a8e8f8 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:49.509030 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0296f-27b6-4a72-94f6-488473a8e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:49.509351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0296f-27b6-4a72-94f6-488473a8e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:49.529090 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-74b0296f-27b6-4a72-94f6-488473a8e8f8 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:49.530780 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-74b0296f-27b6-4a72-94f6-488473a8e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:49.597491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e3692-06e8-4813-8a2b-966ae2e0ce2a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:49.610662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 325/652] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:49.635383 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59ecae-22fb-459e-b153-a56f409ccf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:49.636406 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59ecae-22fb-459e-b153-a56f409ccf7c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:49.636890 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59ecae-22fb-459e-b153-a56f409ccf7c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:49.637414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59ecae-22fb-459e-b153-a56f409ccf7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:49.644557 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59ecae-22fb-459e-b153-a56f409ccf7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:49.646264 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59ecae-22fb-459e-b153-a56f409ccf7c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-ef59ecae-22fb-459e-b153-a56f409ccf7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:49.657935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:49.658814 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:49.659681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:49.659681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:49.659681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:49.659681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:49.659681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:49.659681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:49.659681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:49.659681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:49.661702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 328/653] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:49.667756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0296f-27b6-4a72-94f6-488473a8e8f8 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:49.777507 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0296f-27b6-4a72-94f6-488473a8e8f8 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:49.785685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:49.794791 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16a3e8-2312-4c5f-a5b2-fee50ed0bd1b None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:49.795349 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16a3e8-2312-4c5f-a5b2-fee50ed0bd1b None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:49.795793 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16a3e8-2312-4c5f-a5b2-fee50ed0bd1b None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:49.797490 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 329/654] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:49.802982 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9d6d-6725-4dae-bf95-ab88c90e0fa9 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:49.803269 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9d6d-6725-4dae-bf95-ab88c90e0fa9 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:49.803543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9d6d-6725-4dae-bf95-ab88c90e0fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:49.822282 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48378c-9243-47aa-b73e-fa6fd8e7c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:49.822993 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48378c-9243-47aa-b73e-fa6fd8e7c114 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:49.823273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48378c-9243-47aa-b73e-fa6fd8e7c114 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:49.823630 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48378c-9243-47aa-b73e-fa6fd8e7c114 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:49.824415 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48378c-9243-47aa-b73e-fa6fd8e7c114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:49.824950 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48378c-9243-47aa-b73e-fa6fd8e7c114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:49.825937 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-e4ed9d6d-6725-4dae-bf95-ab88c90e0fa9 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:49.826720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48378c-9243-47aa-b73e-fa6fd8e7c114 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:49.827463 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-e4ed9d6d-6725-4dae-bf95-ab88c90e0fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:49.842800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 326/655] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:49.850331 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48378c-9243-47aa-b73e-fa6fd8e7c114 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:49.905607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:49.921047 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 330/656] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:49.955264 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed9d6d-6725-4dae-bf95-ab88c90e0fa9 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:49.978330 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48378c-9243-47aa-b73e-fa6fd8e7c114 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:50.016890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84409cb1-0c34-457e-9b7b-7cc45e191c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:50.017529 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409cb1-0c34-457e-9b7b-7cc45e191c7a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.017808 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409cb1-0c34-457e-9b7b-7cc45e191c7a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.018079 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409cb1-0c34-457e-9b7b-7cc45e191c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.018794 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84409cb1-0c34-457e-9b7b-7cc45e191c7a None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=9674e78b7a6b41eb8a00aefff4cd22c1) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:50.019102 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84409cb1-0c34-457e-9b7b-7cc45e191c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:50.020545 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84409cb1-0c34-457e-9b7b-7cc45e191c7a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:50.027408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 327/657] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:38:49 2022] GET /identity/v3/role_assignments?user.id=9674e78b7a6b41eb8a00aefff4cd22c1&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:50.028632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723600b-64d8-4736-a963-ff2ba2d28632 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.028920 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723600b-64d8-4736-a963-ff2ba2d28632 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.029273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723600b-64d8-4736-a963-ff2ba2d28632 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.033221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 328/658] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:50.036376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05fc4-b5c5-435f-b2cb-216f9be21372 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.036659 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05fc4-b5c5-435f-b2cb-216f9be21372 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.036957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05fc4-b5c5-435f-b2cb-216f9be21372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.057458 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-22f05fc4-b5c5-435f-b2cb-216f9be21372 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:50.058810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-22f05fc4-b5c5-435f-b2cb-216f9be21372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:50.083063 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed9d6d-6725-4dae-bf95-ab88c90e0fa9 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:50.092112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:50.135284 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd364d-0f16-41c2-8d73-68a1506cb585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:50.137014 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd364d-0f16-41c2-8d73-68a1506cb585 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.137605 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd364d-0f16-41c2-8d73-68a1506cb585 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.138106 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd364d-0f16-41c2-8d73-68a1506cb585 None admin] PATH_INFO: `/v3/services/image` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.139003 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd364d-0f16-41c2-8d73-68a1506cb585 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:50.140787 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd364d-0f16-41c2-8d73-68a1506cb585 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:50.149262 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 329/659] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-fddd364d-0f16-41c2-8d73-68a1506cb585 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:50.163840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:50.173224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:50.174118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 331/660] 10.222.0.52 () {56 vars in 1105 bytes} [Sat Sep 17 20:38:49 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:50.175086 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f05fc4-b5c5-435f-b2cb-216f9be21372 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:50.259346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd364d-0f16-41c2-8d73-68a1506cb585 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:50.295704 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f05fc4-b5c5-435f-b2cb-216f9be21372 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:50.333031 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eaad6-b572-4c3f-aa91-4372c5f949c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:50.333664 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eaad6-b572-4c3f-aa91-4372c5f949c4 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.333945 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eaad6-b572-4c3f-aa91-4372c5f949c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.334218 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eaad6-b572-4c3f-aa91-4372c5f949c4 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.334858 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eaad6-b572-4c3f-aa91-4372c5f949c4 None admin] RBAC: Adding query filter params (name=image) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:50.335160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eaad6-b572-4c3f-aa91-4372c5f949c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:50.336925 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eaad6-b572-4c3f-aa91-4372c5f949c4 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:50.337532 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:50.342036 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 330/661] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:50.347414 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eaad6-b572-4c3f-aa91-4372c5f949c4 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:50.381943 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:50.396625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd364d-0f16-41c2-8d73-68a1506cb585 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:50.450611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab76fda-70c0-4e51-b868-b4af0321ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:50.451505 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76fda-70c0-4e51-b868-b4af0321ff90 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.451929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76fda-70c0-4e51-b868-b4af0321ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.452358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76fda-70c0-4e51-b868-b4af0321ff90 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.453102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab76fda-70c0-4e51-b868-b4af0321ff90 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:50.455218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab76fda-70c0-4e51-b868-b4af0321ff90 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-8ab76fda-70c0-4e51-b868-b4af0321ff90 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:50.468339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:50.469450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 20:38:50.470289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:50.473476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 332/662] 10.222.0.52 () {56 vars in 1129 bytes} [Sat Sep 17 20:38:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:50.480556 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab76fda-70c0-4e51-b868-b4af0321ff90 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:50.489472 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eaad6-b572-4c3f-aa91-4372c5f949c4 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:50.529247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fd399-2667-4978-909a-fe3b4242c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:50.529853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fd399-2667-4978-909a-fe3b4242c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.530179 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fd399-2667-4978-909a-fe3b4242c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.530792 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fd399-2667-4978-909a-fe3b4242c0e0 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.531699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fd399-2667-4978-909a-fe3b4242c0e0 None admin] RBAC: Adding query filter params (type=image) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:50.532050 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fd399-2667-4978-909a-fe3b4242c0e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:50.533602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fd399-2667-4978-909a-fe3b4242c0e0 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:50.545213 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 331/663] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:50.545213 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fd399-2667-4978-909a-fe3b4242c0e0 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:50.614118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab76fda-70c0-4e51-b868-b4af0321ff90 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:50.636333 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:50.654994 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045d000-0699-40c9-ac91-3c499546b055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:50.655769 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045d000-0699-40c9-ac91-3c499546b055 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.656111 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045d000-0699-40c9-ac91-3c499546b055 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.656452 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045d000-0699-40c9-ac91-3c499546b055 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.657201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045d000-0699-40c9-ac91-3c499546b055 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:50.657593 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045d000-0699-40c9-ac91-3c499546b055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:50.659290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045d000-0699-40c9-ac91-3c499546b055 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:50.668963 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 333/664] 10.222.0.52 () {56 vars in 1124 bytes} [Sat Sep 17 20:38:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:50.670176 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045d000-0699-40c9-ac91-3c499546b055 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:50.671585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:50.690742 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fd399-2667-4978-909a-fe3b4242c0e0 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:50.736252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61020-33ab-402c-b585-61f3f1bf4b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:50.737372 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61020-33ab-402c-b585-61f3f1bf4b52 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.737894 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61020-33ab-402c-b585-61f3f1bf4b52 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.738398 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61020-33ab-402c-b585-61f3f1bf4b52 None admin] PATH_INFO: `/v3/services/network` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.739247 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d61020-33ab-402c-b585-61f3f1bf4b52 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:50.740939 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d61020-33ab-402c-b585-61f3f1bf4b52 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-b3d61020-33ab-402c-b585-61f3f1bf4b52 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:50.754876 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:50.755963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 20:38:50.756821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:50.760004 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 332/665] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:50 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:50.766024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61020-33ab-402c-b585-61f3f1bf4b52 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:50.892304 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61020-33ab-402c-b585-61f3f1bf4b52 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:50.917506 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045d000-0699-40c9-ac91-3c499546b055 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:50.928505 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d2eb-83ec-4a28-ba53-b0702df60a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:50.928990 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d2eb-83ec-4a28-ba53-b0702df60a19 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.929339 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d2eb-83ec-4a28-ba53-b0702df60a19 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.929622 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d2eb-83ec-4a28-ba53-b0702df60a19 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.930249 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d2eb-83ec-4a28-ba53-b0702df60a19 None admin] RBAC: Adding query filter params (name=network) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:50.930555 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d2eb-83ec-4a28-ba53-b0702df60a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:50.931938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d2eb-83ec-4a28-ba53-b0702df60a19 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:50.936712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 333/666] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:38:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:50.941972 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d2eb-83ec-4a28-ba53-b0702df60a19 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:50.957272 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb6da1-ed7f-4a7a-b68b-714952a5956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:50.958131 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb6da1-ed7f-4a7a-b68b-714952a5956c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:50.958564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb6da1-ed7f-4a7a-b68b-714952a5956c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:50.959029 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb6da1-ed7f-4a7a-b68b-714952a5956c None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:50.959840 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb6da1-ed7f-4a7a-b68b-714952a5956c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:50.960334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb6da1-ed7f-4a7a-b68b-714952a5956c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:50.962881 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb6da1-ed7f-4a7a-b68b-714952a5956c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:50.963024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:50.973634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 334/667] 10.222.0.52 () {56 vars in 1124 bytes} [Sat Sep 17 20:38:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:51.061276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d2eb-83ec-4a28-ba53-b0702df60a19 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:51.100812 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a05d8-4d4f-4bca-89f5-53c83e9dd307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:51.102319 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a05d8-4d4f-4bca-89f5-53c83e9dd307 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:51.102787 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a05d8-4d4f-4bca-89f5-53c83e9dd307 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:51.103253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a05d8-4d4f-4bca-89f5-53c83e9dd307 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:51.104041 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a05d8-4d4f-4bca-89f5-53c83e9dd307 None admin] RBAC: Adding query filter params (type=network) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:51.104497 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a05d8-4d4f-4bca-89f5-53c83e9dd307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:51.106136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a05d8-4d4f-4bca-89f5-53c83e9dd307 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:51.112059 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 334/668] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:38:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:52.578562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa1a93-2491-4da7-9b9b-116f49cf98c3 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:52.606810 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa1a93-2491-4da7-9b9b-116f49cf98c3 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:52.606810 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa1a93-2491-4da7-9b9b-116f49cf98c3 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:52.606810 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 335/669] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:52.607401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e54e0-dc4c-4fc9-9e02-1da842688764 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:52.607401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e54e0-dc4c-4fc9-9e02-1da842688764 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:52.607401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e54e0-dc4c-4fc9-9e02-1da842688764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:52.607401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-c21e54e0-dc4c-4fc9-9e02-1da842688764 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:52.608522 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-c21e54e0-dc4c-4fc9-9e02-1da842688764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:52.681958 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 335/670] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:53.026215 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa1a93-2491-4da7-9b9b-116f49cf98c3 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:53.067947 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e05e1a-1da3-44ac-8269-ba9125002b45 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.068517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e05e1a-1da3-44ac-8269-ba9125002b45 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.068769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e05e1a-1da3-44ac-8269-ba9125002b45 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.071623 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 336/671] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:53.080567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4580de7-29e7-4a04-8252-ed8cd89f4b6e None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.080567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4580de7-29e7-4a04-8252-ed8cd89f4b6e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.080567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4580de7-29e7-4a04-8252-ed8cd89f4b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.083793 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:53.101431 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-b4580de7-29e7-4a04-8252-ed8cd89f4b6e None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:53.103321 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-b4580de7-29e7-4a04-8252-ed8cd89f4b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:53.107401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:53.158300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa1a93-2491-4da7-9b9b-116f49cf98c3 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:53.198449 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 337/672] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:53.221879 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2b1fb-47f2-49c0-a292-295149a82d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:53.222516 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2b1fb-47f2-49c0-a292-295149a82d6c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.222797 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2b1fb-47f2-49c0-a292-295149a82d6c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.223064 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2b1fb-47f2-49c0-a292-295149a82d6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.234458 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2b1fb-47f2-49c0-a292-295149a82d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-ddd2b1fb-47f2-49c0-a292-295149a82d6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:53.239335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:53.240309 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:53.241908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 336/673] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:38:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:53.246404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4580de7-29e7-4a04-8252-ed8cd89f4b6e None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:53.348224 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4580de7-29e7-4a04-8252-ed8cd89f4b6e None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:53.394521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c482e-ef63-4a1b-8086-16bf54756ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:53.395480 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c482e-ef63-4a1b-8086-16bf54756ad9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.395953 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c482e-ef63-4a1b-8086-16bf54756ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.396522 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c482e-ef63-4a1b-8086-16bf54756ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.397480 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c482e-ef63-4a1b-8086-16bf54756ad9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:53.401056 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c482e-ef63-4a1b-8086-16bf54756ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:53.402659 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c482e-ef63-4a1b-8086-16bf54756ad9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:53.412308 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 338/674] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:53.419500 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2b1fb-47f2-49c0-a292-295149a82d6c None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:53.531553 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2b1fb-47f2-49c0-a292-295149a82d6c None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:53.539785 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:53.555604 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c482e-ef63-4a1b-8086-16bf54756ad9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:53.558640 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:53.569471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533fb49-198a-4f54-baec-a4a5dca1f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:53.570666 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533fb49-198a-4f54-baec-a4a5dca1f19f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.570957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533fb49-198a-4f54-baec-a4a5dca1f19f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.571218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533fb49-198a-4f54-baec-a4a5dca1f19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.583918 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533fb49-198a-4f54-baec-a4a5dca1f19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:53.586403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533fb49-198a-4f54-baec-a4a5dca1f19f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-5533fb49-198a-4f54-baec-a4a5dca1f19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:53.607009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:53.608033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:53.609537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:53.609537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:53.609537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:53.609537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 337/675] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:53.609766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca13af-e8c2-4500-9c1a-3b00e3defd72 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.610024 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca13af-e8c2-4500-9c1a-3b00e3defd72 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.610297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca13af-e8c2-4500-9c1a-3b00e3defd72 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.611674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 338/676] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:53.613597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca13af-e8c2-4500-9c1a-3b00e3defd72 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:53.674115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c482e-ef63-4a1b-8086-16bf54756ad9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:53.708011 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a7add-3ef1-4830-a48e-69784f8f3147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:53.708620 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7add-3ef1-4830-a48e-69784f8f3147 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.708901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7add-3ef1-4830-a48e-69784f8f3147 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.709207 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7add-3ef1-4830-a48e-69784f8f3147 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.709882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a7add-3ef1-4830-a48e-69784f8f3147 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:53.711820 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a7add-3ef1-4830-a48e-69784f8f3147 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:53.715600 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca13af-e8c2-4500-9c1a-3b00e3defd72 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:53.758907 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389a9dd-345e-43dd-a86b-ebb146359fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:53.759501 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389a9dd-345e-43dd-a86b-ebb146359fad None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.759772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389a9dd-345e-43dd-a86b-ebb146359fad None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.760034 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389a9dd-345e-43dd-a86b-ebb146359fad None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.760660 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389a9dd-345e-43dd-a86b-ebb146359fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:53.760953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389a9dd-345e-43dd-a86b-ebb146359fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:53.762340 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389a9dd-345e-43dd-a86b-ebb146359fad None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:53.773892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 339/677] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:53.775013 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3bd1-6c43-4ede-8263-f39ed784d3fa None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.775291 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3bd1-6c43-4ede-8263-f39ed784d3fa None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.775557 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3bd1-6c43-4ede-8263-f39ed784d3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.793989 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-f85f3bd1-6c43-4ede-8263-f39ed784d3fa None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:53.799334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-f85f3bd1-6c43-4ede-8263-f39ed784d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:53.808758 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:53.826145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 339/678] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:38:53 2022] POST /identity/v3/services => generated 242 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:38:53.828121 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e741-27d5-43bb-8a52-d833075aac0e None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.828121 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e741-27d5-43bb-8a52-d833075aac0e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.828121 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e741-27d5-43bb-8a52-d833075aac0e None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.829044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 340/679] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:53.829791 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e741-27d5-43bb-8a52-d833075aac0e None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:53.885447 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 340/680] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:53 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:53.887911 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9afa33-4a6a-4f99-9d62-a903dc49b573 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:53.888438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9afa33-4a6a-4f99-9d62-a903dc49b573 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:53.889450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9afa33-4a6a-4f99-9d62-a903dc49b573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:53.912689 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:53.917809 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-af9afa33-4a6a-4f99-9d62-a903dc49b573 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:53.920228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-af9afa33-4a6a-4f99-9d62-a903dc49b573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:53.961077 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e741-27d5-43bb-8a52-d833075aac0e None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:54.013345 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35dbd1-df1e-4b20-9b12-73fcb26244c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:54.014328 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35dbd1-df1e-4b20-9b12-73fcb26244c9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:54.014785 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35dbd1-df1e-4b20-9b12-73fcb26244c9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:54.015226 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35dbd1-df1e-4b20-9b12-73fcb26244c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:54.017773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 341/681] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:53 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 20:38:54.025963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35dbd1-df1e-4b20-9b12-73fcb26244c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:54.027872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35dbd1-df1e-4b20-9b12-73fcb26244c9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-0b35dbd1-df1e-4b20-9b12-73fcb26244c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:54.042341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:54.052210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:54.053140 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 341/682] 10.222.0.52 () {56 vars in 1093 bytes} [Sat Sep 17 20:38:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:54.053804 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9afa33-4a6a-4f99-9d62-a903dc49b573 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:54.141749 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:54.168503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9afa33-4a6a-4f99-9d62-a903dc49b573 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:54.204324 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc3275-7377-451d-8b75-e837ee7ab48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:54.204935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc3275-7377-451d-8b75-e837ee7ab48a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:54.205298 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc3275-7377-451d-8b75-e837ee7ab48a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:54.205574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc3275-7377-451d-8b75-e837ee7ab48a None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:54.206297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc3275-7377-451d-8b75-e837ee7ab48a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:54.206602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc3275-7377-451d-8b75-e837ee7ab48a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:54.208039 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc3275-7377-451d-8b75-e837ee7ab48a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:54.228979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35dbd1-df1e-4b20-9b12-73fcb26244c9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:54.234612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 342/683] 10.222.0.52 () {56 vars in 1133 bytes} [Sat Sep 17 20:38:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:54.240129 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc3275-7377-451d-8b75-e837ee7ab48a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:54.340031 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35dbd1-df1e-4b20-9b12-73fcb26244c9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:54.368951 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc3275-7377-451d-8b75-e837ee7ab48a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:54.370037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:54.385514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26d96f-7256-4176-b567-ea10f0e86710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:54.386116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26d96f-7256-4176-b567-ea10f0e86710 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:54.386400 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26d96f-7256-4176-b567-ea10f0e86710 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:54.386680 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26d96f-7256-4176-b567-ea10f0e86710 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:54.387341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26d96f-7256-4176-b567-ea10f0e86710 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:54.388946 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26d96f-7256-4176-b567-ea10f0e86710 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:54.403480 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:54.408471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2db3-8a8e-4178-9513-49b70f36e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:54.409106 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2db3-8a8e-4178-9513-49b70f36e5ba None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:54.409426 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2db3-8a8e-4178-9513-49b70f36e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:54.409698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2db3-8a8e-4178-9513-49b70f36e5ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:54.420527 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2db3-8a8e-4178-9513-49b70f36e5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:54.422003 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2db3-8a8e-4178-9513-49b70f36e5ba None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-84ae2db3-8a8e-4178-9513-49b70f36e5ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:54.436541 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:54.437589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:54.448836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:54.448836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:54.448836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:54.448836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 343/684] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:54.448836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2db3-8a8e-4178-9513-49b70f36e5ba None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:54.472748 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 342/685] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:38:54 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:38:54.473947 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26d96f-7256-4176-b567-ea10f0e86710 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:54.572586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2db3-8a8e-4178-9513-49b70f36e5ba None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:54.618805 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abd1e-b0f7-4acf-a2e3-c66b87331569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:54.620167 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abd1e-b0f7-4acf-a2e3-c66b87331569 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:54.620683 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abd1e-b0f7-4acf-a2e3-c66b87331569 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:54.621145 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abd1e-b0f7-4acf-a2e3-c66b87331569 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:54.622044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5abd1e-b0f7-4acf-a2e3-c66b87331569 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:54.623649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5abd1e-b0f7-4acf-a2e3-c66b87331569 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:54.624066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26d96f-7256-4176-b567-ea10f0e86710 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:54.670420 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adab83-91ca-45bc-8b78-5dca2f582f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:54.670941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adab83-91ca-45bc-8b78-5dca2f582f61 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:54.671220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adab83-91ca-45bc-8b78-5dca2f582f61 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:54.671495 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adab83-91ca-45bc-8b78-5dca2f582f61 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:54.672155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adab83-91ca-45bc-8b78-5dca2f582f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:54.672467 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adab83-91ca-45bc-8b78-5dca2f582f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:54.673905 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adab83-91ca-45bc-8b78-5dca2f582f61 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:54.692431 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 343/686] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:54.694745 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adab83-91ca-45bc-8b78-5dca2f582f61 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:54.724703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 344/687] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:38:54 2022] POST /identity/v3/services => generated 240 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:38:54.755474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:54.828550 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adab83-91ca-45bc-8b78-5dca2f582f61 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:54.885807 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b5d9-c819-4cb5-adb4-773852bc7aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:54.886464 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b5d9-c819-4cb5-adb4-773852bc7aee None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:54.886728 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b5d9-c819-4cb5-adb4-773852bc7aee None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:54.886998 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b5d9-c819-4cb5-adb4-773852bc7aee None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:54.894800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b5d9-c819-4cb5-adb4-773852bc7aee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:54.896303 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b5d9-c819-4cb5-adb4-773852bc7aee None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-5760b5d9-c819-4cb5-adb4-773852bc7aee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:38:54.909666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:54.910632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:54.911517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:38:54.911517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:38:54.911517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:38:54.911517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:38:54.911517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:38:54.911517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:38:54.911517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:38:54.911517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:54.916080 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 344/688] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:54.917615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abd1e-b0f7-4acf-a2e3-c66b87331569 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:54.967704 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:55.030923 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abd1e-b0f7-4acf-a2e3-c66b87331569 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:55.068811 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee50c6a-7109-46e6-8554-ff956c47b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:55.069869 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50c6a-7109-46e6-8554-ff956c47b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:55.070712 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50c6a-7109-46e6-8554-ff956c47b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:55.071246 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50c6a-7109-46e6-8554-ff956c47b5d2 None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:55.072157 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50c6a-7109-46e6-8554-ff956c47b5d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:55.072681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50c6a-7109-46e6-8554-ff956c47b5d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:55.074391 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50c6a-7109-46e6-8554-ff956c47b5d2 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:55.088016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 345/689] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:38:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:55.094624 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b5d9-c819-4cb5-adb4-773852bc7aee None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:55.203969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:55.207597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b5d9-c819-4cb5-adb4-773852bc7aee None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:55.245024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d659d-5eb7-4647-b699-327037727cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:55.245632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d659d-5eb7-4647-b699-327037727cdf None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:55.245911 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d659d-5eb7-4647-b699-327037727cdf None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:55.246182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d659d-5eb7-4647-b699-327037727cdf None admin] PATH_INFO: `/v3/projects/8626e1dba10a49f2a16ae81553658423/users/9674e78b7a6b41eb8a00aefff4cd22c1/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:55.248180 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d659d-5eb7-4647-b699-327037727cdf None admin] RBAC: Authorizing `identity:create_grant(project_id=8626e1dba10a49f2a16ae81553658423, user_id=9674e78b7a6b41eb8a00aefff4cd22c1, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:55.250088 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d659d-5eb7-4647-b699-327037727cdf None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:55.373520 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 345/690] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:38:55 2022] PUT /identity/v3/projects/8626e1dba10a49f2a16ae81553658423/users/9674e78b7a6b41eb8a00aefff4cd22c1/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:38:56.362440 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae6b9c-8fab-4b57-a1db-d4862e81ea37 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:56.362990 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae6b9c-8fab-4b57-a1db-d4862e81ea37 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:56.362990 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae6b9c-8fab-4b57-a1db-d4862e81ea37 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:56.364524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 346/691] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:56.369988 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bc84-ef49-4b61-92ce-2c64fc9761f5 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:56.370394 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bc84-ef49-4b61-92ce-2c64fc9761f5 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:56.370586 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bc84-ef49-4b61-92ce-2c64fc9761f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:56.389120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-c0e6bc84-ef49-4b61-92ce-2c64fc9761f5 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:56.390658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-c0e6bc84-ef49-4b61-92ce-2c64fc9761f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:56.467190 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 346/692] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:38:56.817431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae6b9c-8fab-4b57-a1db-d4862e81ea37 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:56.930357 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:56.934042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae6b9c-8fab-4b57-a1db-d4862e81ea37 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:56.971021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b8bb9-6960-47c8-91f3-312686c0a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:56.971647 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8bb9-6960-47c8-91f3-312686c0a5b1 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:56.971933 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8bb9-6960-47c8-91f3-312686c0a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:56.972201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8bb9-6960-47c8-91f3-312686c0a5b1 None admin] PATH_INFO: `/v3/services/image` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:56.972778 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b8bb9-6960-47c8-91f3-312686c0a5b1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:56.974179 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b8bb9-6960-47c8-91f3-312686c0a5b1 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-997b8bb9-6960-47c8-91f3-312686c0a5b1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:56.983439 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:56.984456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:56.985359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 347/693] 10.222.0.52 () {56 vars in 1105 bytes} [Sat Sep 17 20:38:56 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:56.990314 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bc84-ef49-4b61-92ce-2c64fc9761f5 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:57.086829 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:57.099732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bc84-ef49-4b61-92ce-2c64fc9761f5 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:57.128424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53567d-cc62-4e25-95fc-62e82a50c527 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:57.128712 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53567d-cc62-4e25-95fc-62e82a50c527 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:57.129153 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53567d-cc62-4e25-95fc-62e82a50c527 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:57.130823 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 348/694] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:57.136047 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1c886-48a0-4332-98f3-6242679f2223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:57.136574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad712ee-82fb-4967-82cc-ef6dab53a473 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:57.136687 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1c886-48a0-4332-98f3-6242679f2223 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:57.136922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1c886-48a0-4332-98f3-6242679f2223 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:57.137025 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad712ee-82fb-4967-82cc-ef6dab53a473 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:57.137221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1c886-48a0-4332-98f3-6242679f2223 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:57.137539 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad712ee-82fb-4967-82cc-ef6dab53a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:57.137861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1c886-48a0-4332-98f3-6242679f2223 None admin] RBAC: Adding query filter params (name=image) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:57.138165 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1c886-48a0-4332-98f3-6242679f2223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:57.139538 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1c886-48a0-4332-98f3-6242679f2223 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:57.144806 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 347/695] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:57.154299 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1c886-48a0-4332-98f3-6242679f2223 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:57.165401 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-bad712ee-82fb-4967-82cc-ef6dab53a473 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:57.166605 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-bad712ee-82fb-4967-82cc-ef6dab53a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:57.245674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 349/696] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 20:38:57.265483 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1c886-48a0-4332-98f3-6242679f2223 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:57.301793 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10b7e5-3ae7-4bc3-bd6e-c501a7f6ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:57.302401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b7e5-3ae7-4bc3-bd6e-c501a7f6ab17 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:57.302685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b7e5-3ae7-4bc3-bd6e-c501a7f6ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:57.302956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b7e5-3ae7-4bc3-bd6e-c501a7f6ab17 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:57.303583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10b7e5-3ae7-4bc3-bd6e-c501a7f6ab17 None admin] RBAC: Adding query filter params (type=image) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:57.303885 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10b7e5-3ae7-4bc3-bd6e-c501a7f6ab17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:57.305541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10b7e5-3ae7-4bc3-bd6e-c501a7f6ab17 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:57.310552 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026e001-5dcb-4604-b351-300b20e26937 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:57.310837 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026e001-5dcb-4604-b351-300b20e26937 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:57.311025 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 348/697] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:57.311196 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026e001-5dcb-4604-b351-300b20e26937 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:57.312464 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 350/698] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:38:57.316387 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10b7e5-3ae7-4bc3-bd6e-c501a7f6ab17 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:57.317706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4a038-0fb5-42f4-8a96-020a0108f5d5 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:57.318052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4a038-0fb5-42f4-8a96-020a0108f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:57.318651 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4a038-0fb5-42f4-8a96-020a0108f5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:57.338401 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-a5d4a038-0fb5-42f4-8a96-020a0108f5d5 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:57.339601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-a5d4a038-0fb5-42f4-8a96-020a0108f5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:57.339778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:57.418359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 351/699] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:38:57.452253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10b7e5-3ae7-4bc3-bd6e-c501a7f6ab17 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:57.492599 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0f654-8f88-4c87-8a83-af383413abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:57.493541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0f654-8f88-4c87-8a83-af383413abba None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:57.493867 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0f654-8f88-4c87-8a83-af383413abba None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:57.494143 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0f654-8f88-4c87-8a83-af383413abba None admin] PATH_INFO: `/v3/endpoints` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:57.494852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0f654-8f88-4c87-8a83-af383413abba None admin] RBAC: Adding query filter params (interface=public, service_id=7cea14fa04dd40a18ce5746e0528d64b, region_id=RegionOne) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:57.495155 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0f654-8f88-4c87-8a83-af383413abba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:57.496550 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0f654-8f88-4c87-8a83-af383413abba None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:57.505350 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 349/700] 10.222.0.52 () {56 vars in 1251 bytes} [Sat Sep 17 20:38:57 2022] GET /identity/v3/endpoints?service_id=7cea14fa04dd40a18ce5746e0528d64b&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:57.511138 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4a038-0fb5-42f4-8a96-020a0108f5d5 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:57.537040 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:57.614285 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0f654-8f88-4c87-8a83-af383413abba None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:57.631206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4a038-0fb5-42f4-8a96-020a0108f5d5 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:57.688802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307ffff-5267-4e6f-a548-e2dca58e7931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:57.688802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307ffff-5267-4e6f-a548-e2dca58e7931 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:57.688802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307ffff-5267-4e6f-a548-e2dca58e7931 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:57.688802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307ffff-5267-4e6f-a548-e2dca58e7931 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:57.689286 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307ffff-5267-4e6f-a548-e2dca58e7931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:57.690057 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307ffff-5267-4e6f-a548-e2dca58e7931 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:57.700714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 352/701] 10.222.0.52 () {56 vars in 1087 bytes} [Sat Sep 17 20:38:57 2022] GET /identity/v3/services => generated 1002 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:38:57.730383 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:57.763760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307ffff-5267-4e6f-a548-e2dca58e7931 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:57.777868 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0f654-8f88-4c87-8a83-af383413abba None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:57.847100 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f24bf-46d3-4b1e-84ca-1207e120cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:57.847750 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f24bf-46d3-4b1e-84ca-1207e120cddd None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:57.848026 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f24bf-46d3-4b1e-84ca-1207e120cddd None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:57.848293 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f24bf-46d3-4b1e-84ca-1207e120cddd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:57.848884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f24bf-46d3-4b1e-84ca-1207e120cddd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:57.850317 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f24bf-46d3-4b1e-84ca-1207e120cddd None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-eb5f24bf-46d3-4b1e-84ca-1207e120cddd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:57.878438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:57.879457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 20:38:57.880276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:57.881604 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 350/702] 10.222.0.52 () {56 vars in 1129 bytes} [Sat Sep 17 20:38:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:57.885896 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f24bf-46d3-4b1e-84ca-1207e120cddd None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:57.924810 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:57.952216 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307ffff-5267-4e6f-a548-e2dca58e7931 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:58.000642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb909d-613a-4345-b2d9-b80cbc735ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:58.001317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb909d-613a-4345-b2d9-b80cbc735ffa None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.001626 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb909d-613a-4345-b2d9-b80cbc735ffa None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.001866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb909d-613a-4345-b2d9-b80cbc735ffa None admin] PATH_INFO: `/v3/services/network` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.002489 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb909d-613a-4345-b2d9-b80cbc735ffa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:58.003798 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb909d-613a-4345-b2d9-b80cbc735ffa None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-56cb909d-613a-4345-b2d9-b80cbc735ffa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:58.014566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:58.015649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:58.016471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 353/703] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:38:57 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:38:58.022644 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae803dd-2086-4148-8138-563e37975633 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.023483 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae803dd-2086-4148-8138-563e37975633 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.026946 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae803dd-2086-4148-8138-563e37975633 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.026946 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 354/704] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:38:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:38:58.026946 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae803dd-2086-4148-8138-563e37975633 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:58.152652 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae803dd-2086-4148-8138-563e37975633 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:58.165390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f24bf-46d3-4b1e-84ca-1207e120cddd None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:58.202225 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d0f2-28ff-4933-ab9a-6a4d343354d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:58.203474 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d0f2-28ff-4933-ab9a-6a4d343354d0 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.203822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d0f2-28ff-4933-ab9a-6a4d343354d0 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.204186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d0f2-28ff-4933-ab9a-6a4d343354d0 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.204931 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7d0f2-28ff-4933-ab9a-6a4d343354d0 None admin] RBAC: Adding query filter params (name=network) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:58.205330 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7d0f2-28ff-4933-ab9a-6a4d343354d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:58.207061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7d0f2-28ff-4933-ab9a-6a4d343354d0 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:58.207174 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8c380-0ba6-45c7-a4e6-73417722820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:58.207727 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8c380-0ba6-45c7-a4e6-73417722820b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.208011 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8c380-0ba6-45c7-a4e6-73417722820b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.208288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8c380-0ba6-45c7-a4e6-73417722820b None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.209244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8c380-0ba6-45c7-a4e6-73417722820b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:58.209919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8c380-0ba6-45c7-a4e6-73417722820b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:58.211902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8c380-0ba6-45c7-a4e6-73417722820b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:58.221471 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 351/705] 10.222.0.52 () {56 vars in 1124 bytes} [Sat Sep 17 20:38:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:58.221471 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bebdd2-4979-4155-abf8-a74ba8cb11c1 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.221471 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bebdd2-4979-4155-abf8-a74ba8cb11c1 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.221471 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bebdd2-4979-4155-abf8-a74ba8cb11c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.221849 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 355/706] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:38:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:58.221849 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d0f2-28ff-4933-ab9a-6a4d343354d0 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:58.240263 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-c4bebdd2-4979-4155-abf8-a74ba8cb11c1 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:38:58.241540 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-c4bebdd2-4979-4155-abf8-a74ba8cb11c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:38:58.244600 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:58.246111 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:58.322305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 352/707] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:38:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:38:58.323503 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bebdd2-4979-4155-abf8-a74ba8cb11c1 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:58.349158 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d0f2-28ff-4933-ab9a-6a4d343354d0 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:58.391480 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8700b-9130-456d-9ff1-b6d6f6cd46e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:58.392446 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8700b-9130-456d-9ff1-b6d6f6cd46e4 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.392978 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8700b-9130-456d-9ff1-b6d6f6cd46e4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.393583 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8700b-9130-456d-9ff1-b6d6f6cd46e4 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.394434 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8700b-9130-456d-9ff1-b6d6f6cd46e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:58.394951 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8700b-9130-456d-9ff1-b6d6f6cd46e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:58.396766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8700b-9130-456d-9ff1-b6d6f6cd46e4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:58.404223 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 356/708] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:38:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:58.411452 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8700b-9130-456d-9ff1-b6d6f6cd46e4 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:58.456061 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bebdd2-4979-4155-abf8-a74ba8cb11c1 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:58.496430 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dd1e-ba1f-4435-a3eb-b9520a4a8ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:58.497032 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dd1e-ba1f-4435-a3eb-b9520a4a8ca4 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.497523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dd1e-ba1f-4435-a3eb-b9520a4a8ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.500479 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dd1e-ba1f-4435-a3eb-b9520a4a8ca4 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.501430 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58dd1e-ba1f-4435-a3eb-b9520a4a8ca4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:58.501740 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58dd1e-ba1f-4435-a3eb-b9520a4a8ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:58.503114 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58dd1e-ba1f-4435-a3eb-b9520a4a8ca4 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:58.514534 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 353/709] 10.222.0.52 () {56 vars in 1124 bytes} [Sat Sep 17 20:38:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:58.515812 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dd1e-ba1f-4435-a3eb-b9520a4a8ca4 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:58.519083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:58.534029 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:58.562238 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8700b-9130-456d-9ff1-b6d6f6cd46e4 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:58.606260 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c2ad1-b0a2-402c-9b67-2cf4fe790683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:58.606875 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c2ad1-b0a2-402c-9b67-2cf4fe790683 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.607156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c2ad1-b0a2-402c-9b67-2cf4fe790683 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.607425 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c2ad1-b0a2-402c-9b67-2cf4fe790683 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.608283 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c2ad1-b0a2-402c-9b67-2cf4fe790683 None admin] RBAC: Adding query filter params (interface=public, service_id=1ebe5506063847ed85095356bab006a0, region_id=RegionOne) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:58.608591 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c2ad1-b0a2-402c-9b67-2cf4fe790683 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:58.610588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c2ad1-b0a2-402c-9b67-2cf4fe790683 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:58.629086 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 357/710] 10.222.0.52 () {56 vars in 1251 bytes} [Sat Sep 17 20:38:58 2022] GET /identity/v3/endpoints?service_id=1ebe5506063847ed85095356bab006a0&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:58.630316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c2ad1-b0a2-402c-9b67-2cf4fe790683 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:58.657930 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dd1e-ba1f-4435-a3eb-b9520a4a8ca4 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:58.702635 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b839b1-e50e-4696-bc7d-2fc7d828a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:58.703350 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b839b1-e50e-4696-bc7d-2fc7d828a916 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.703732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b839b1-e50e-4696-bc7d-2fc7d828a916 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.704012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b839b1-e50e-4696-bc7d-2fc7d828a916 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.704704 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b839b1-e50e-4696-bc7d-2fc7d828a916 None admin] RBAC: Adding query filter params (interface=public, service_id=fe128438da7a4b72883422042a0fefa2, region_id=RegionOne) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:58.705014 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b839b1-e50e-4696-bc7d-2fc7d828a916 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:58.706475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b839b1-e50e-4696-bc7d-2fc7d828a916 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:58.717338 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 354/711] 10.222.0.52 () {56 vars in 1251 bytes} [Sat Sep 17 20:38:58 2022] GET /identity/v3/endpoints?service_id=fe128438da7a4b72883422042a0fefa2&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:58.718294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b839b1-e50e-4696-bc7d-2fc7d828a916 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:58.763277 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c2ad1-b0a2-402c-9b67-2cf4fe790683 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:58.797766 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:58.813572 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360782c-d4ea-4f45-9d12-ad13d1044fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:58.814238 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360782c-d4ea-4f45-9d12-ad13d1044fa9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.814898 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360782c-d4ea-4f45-9d12-ad13d1044fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.815175 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360782c-d4ea-4f45-9d12-ad13d1044fa9 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.815861 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360782c-d4ea-4f45-9d12-ad13d1044fa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:58.817205 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360782c-d4ea-4f45-9d12-ad13d1044fa9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:58.833369 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 358/712] 10.222.0.52 () {56 vars in 1087 bytes} [Sat Sep 17 20:38:58 2022] GET /identity/v3/services => generated 1002 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 20:38:58.833369 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360782c-d4ea-4f45-9d12-ad13d1044fa9 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:58.843546 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:58.858808 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b839b1-e50e-4696-bc7d-2fc7d828a916 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:58.919436 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614215d-fdbf-4807-9c06-7b8258784b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:58.921324 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614215d-fdbf-4807-9c06-7b8258784b16 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:58.921667 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614215d-fdbf-4807-9c06-7b8258784b16 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:58.921969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614215d-fdbf-4807-9c06-7b8258784b16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:58.940401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614215d-fdbf-4807-9c06-7b8258784b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-d614215d-fdbf-4807-9c06-7b8258784b16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:38:58.946810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:58.948658 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:38:58.950237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 355/713] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:58.954320 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614215d-fdbf-4807-9c06-7b8258784b16 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:58.984247 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360782c-d4ea-4f45-9d12-ad13d1044fa9 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:59.031648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c14c50-b6c6-4849-afe7-297a4740f01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:59.032287 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c14c50-b6c6-4849-afe7-297a4740f01d None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:59.032669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c14c50-b6c6-4849-afe7-297a4740f01d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:59.032952 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c14c50-b6c6-4849-afe7-297a4740f01d None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:59.033743 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c14c50-b6c6-4849-afe7-297a4740f01d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:59.035260 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c14c50-b6c6-4849-afe7-297a4740f01d None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:59.049300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 359/714] 10.222.0.52 () {56 vars in 1087 bytes} [Sat Sep 17 20:38:58 2022] GET /identity/v3/services => generated 1002 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:38:59.097422 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614215d-fdbf-4807-9c06-7b8258784b16 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:59.139780 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:59.150785 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1ba70-b2c5-4652-a563-0af682c48506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:59.151414 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1ba70-b2c5-4652-a563-0af682c48506 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:59.151710 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1ba70-b2c5-4652-a563-0af682c48506 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:59.151996 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1ba70-b2c5-4652-a563-0af682c48506 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:59.152710 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1ba70-b2c5-4652-a563-0af682c48506 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:59.153014 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1ba70-b2c5-4652-a563-0af682c48506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:59.154459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1ba70-b2c5-4652-a563-0af682c48506 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:59.165799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 356/715] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:38:59.171685 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c14c50-b6c6-4849-afe7-297a4740f01d None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:59.271679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:59.309543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c14c50-b6c6-4849-afe7-297a4740f01d None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:59.355656 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1174-4fbd-40d2-941f-498568376bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:59.356289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1174-4fbd-40d2-941f-498568376bde None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:59.356566 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1174-4fbd-40d2-941f-498568376bde None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:59.356833 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1174-4fbd-40d2-941f-498568376bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:59.374801 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1174-4fbd-40d2-941f-498568376bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:59.376262 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1174-4fbd-40d2-941f-498568376bde None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-70bf1174-4fbd-40d2-941f-498568376bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:38:59.394997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:59.397703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:38:59.399926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:38:59.399926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:38:59.399926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:59.399926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 360/716] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:59.405187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1ba70-b2c5-4652-a563-0af682c48506 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:59.527369 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1ba70-b2c5-4652-a563-0af682c48506 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:59.568708 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5539a-e0b7-4ba5-8ee3-691c6230d878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:59.569344 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5539a-e0b7-4ba5-8ee3-691c6230d878 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:59.569797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5539a-e0b7-4ba5-8ee3-691c6230d878 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:59.570150 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5539a-e0b7-4ba5-8ee3-691c6230d878 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:59.570808 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5539a-e0b7-4ba5-8ee3-691c6230d878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:59.571114 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5539a-e0b7-4ba5-8ee3-691c6230d878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:59.572486 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5539a-e0b7-4ba5-8ee3-691c6230d878 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:59.591024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 357/717] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:59.596191 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1174-4fbd-40d2-941f-498568376bde None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:59.704818 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1174-4fbd-40d2-941f-498568376bde None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:59.729780 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:59.740570 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0d83-29e8-44f3-9a19-f5eb0c4404c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:59.741555 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0d83-29e8-44f3-9a19-f5eb0c4404c8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:59.742712 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0d83-29e8-44f3-9a19-f5eb0c4404c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:59.743410 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0d83-29e8-44f3-9a19-f5eb0c4404c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:59.756179 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d0d83-29e8-44f3-9a19-f5eb0c4404c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:59.758038 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d0d83-29e8-44f3-9a19-f5eb0c4404c8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-eb2d0d83-29e8-44f3-9a19-f5eb0c4404c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:38:59.770752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:38:59.771706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:38:59.772672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 361/718] 10.222.0.52 () {56 vars in 1093 bytes} [Sat Sep 17 20:38:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:38:59.780171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5539a-e0b7-4ba5-8ee3-691c6230d878 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:38:59.844599 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:38:59.905028 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5539a-e0b7-4ba5-8ee3-691c6230d878 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:38:59.940710 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ffba-5da2-4c4e-97d2-d53f7bedf98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:38:59.941352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ffba-5da2-4c4e-97d2-d53f7bedf98e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:38:59.941628 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ffba-5da2-4c4e-97d2-d53f7bedf98e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:38:59.941897 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ffba-5da2-4c4e-97d2-d53f7bedf98e None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:38:59.942623 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116ffba-5da2-4c4e-97d2-d53f7bedf98e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:38:59.942931 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116ffba-5da2-4c4e-97d2-d53f7bedf98e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:38:59.944626 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116ffba-5da2-4c4e-97d2-d53f7bedf98e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:38:59.963273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 358/719] 10.222.0.52 () {56 vars in 1133 bytes} [Sat Sep 17 20:38:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:38:59.969070 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0d83-29e8-44f3-9a19-f5eb0c4404c8 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:00.080700 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0d83-29e8-44f3-9a19-f5eb0c4404c8 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:00.115334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb94bf-a2a1-4ad8-abb8-5fe6ff5171e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:00.115932 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb94bf-a2a1-4ad8-abb8-5fe6ff5171e9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:00.116203 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb94bf-a2a1-4ad8-abb8-5fe6ff5171e9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:00.116469 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb94bf-a2a1-4ad8-abb8-5fe6ff5171e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:00.169693 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:00.186156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb94bf-a2a1-4ad8-abb8-5fe6ff5171e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:00.187611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb94bf-a2a1-4ad8-abb8-5fe6ff5171e9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:00.287372 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 362/720] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:38:59 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 20:39:00.293070 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ffba-5da2-4c4e-97d2-d53f7bedf98e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:00.403646 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ffba-5da2-4c4e-97d2-d53f7bedf98e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:00.411312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:00.439170 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06033ac-26f2-4520-9414-b0bba6d982de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:00.439794 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06033ac-26f2-4520-9414-b0bba6d982de None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:00.440070 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06033ac-26f2-4520-9414-b0bba6d982de None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:00.440338 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06033ac-26f2-4520-9414-b0bba6d982de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:00.455842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06033ac-26f2-4520-9414-b0bba6d982de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:00.457743 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06033ac-26f2-4520-9414-b0bba6d982de None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-a06033ac-26f2-4520-9414-b0bba6d982de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:39:00.474977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:00.477938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:39:00.478860 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:39:00.478860 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:39:00.478860 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:00.479621 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 359/721] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:39:00.485539 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb94bf-a2a1-4ad8-abb8-5fe6ff5171e9 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:00.495408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04db10-4520-4ba0-a04f-0399744734cd None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:00.495690 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04db10-4520-4ba0-a04f-0399744734cd None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:00.495966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04db10-4520-4ba0-a04f-0399744734cd None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:00.497326 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 360/722] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:39:00.502607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff38196-db9f-4ec8-887d-52af37866d80 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:00.502970 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff38196-db9f-4ec8-887d-52af37866d80 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:00.503306 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff38196-db9f-4ec8-887d-52af37866d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:00.523089 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-4ff38196-db9f-4ec8-887d-52af37866d80 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:00.524480 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-4ff38196-db9f-4ec8-887d-52af37866d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:00.580010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:00.605196 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb94bf-a2a1-4ad8-abb8-5fe6ff5171e9 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:00.605948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 361/723] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 20:39:00.639236 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b860bd-3592-4b27-ad4f-848a2fc2d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:00.639953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b860bd-3592-4b27-ad4f-848a2fc2d59a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:00.640300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b860bd-3592-4b27-ad4f-848a2fc2d59a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:00.640636 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b860bd-3592-4b27-ad4f-848a2fc2d59a None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:00.641366 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b860bd-3592-4b27-ad4f-848a2fc2d59a None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:00.641730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b860bd-3592-4b27-ad4f-848a2fc2d59a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:00.643144 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b860bd-3592-4b27-ad4f-848a2fc2d59a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:00.655306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 363/724] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:00.660483 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff38196-db9f-4ec8-887d-52af37866d80 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:00.753756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:00.766307 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff38196-db9f-4ec8-887d-52af37866d80 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:00.801363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb457d10-d79a-48d0-ab0b-b29d29f85ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:00.801990 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb457d10-d79a-48d0-ab0b-b29d29f85ff9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:00.802269 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb457d10-d79a-48d0-ab0b-b29d29f85ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:00.802544 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb457d10-d79a-48d0-ab0b-b29d29f85ff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:00.818582 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb457d10-d79a-48d0-ab0b-b29d29f85ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:00.820277 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb457d10-d79a-48d0-ab0b-b29d29f85ff9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-fb457d10-d79a-48d0-ab0b-b29d29f85ff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:39:00.831602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:00.832459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:00.833778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:39:00.833778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:39:00.833778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:39:00.833778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:39:00.833778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:39:00.833778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:39:00.833778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:39:00.833778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:00.833778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 362/725] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:39:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:00.838783 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b860bd-3592-4b27-ad4f-848a2fc2d59a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:00.943045 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb457d10-d79a-48d0-ab0b-b29d29f85ff9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:00.959050 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b860bd-3592-4b27-ad4f-848a2fc2d59a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:01.001786 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be08bd-4b6f-442e-a765-1853919b6908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:01.002397 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be08bd-4b6f-442e-a765-1853919b6908 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.002679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be08bd-4b6f-442e-a765-1853919b6908 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.002953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be08bd-4b6f-442e-a765-1853919b6908 None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.003643 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be08bd-4b6f-442e-a765-1853919b6908 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:01.003950 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be08bd-4b6f-442e-a765-1853919b6908 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:01.005402 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be08bd-4b6f-442e-a765-1853919b6908 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:01.019228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 364/726] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:39:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:01.025673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be08bd-4b6f-442e-a765-1853919b6908 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:01.034275 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:01.065425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb457d10-d79a-48d0-ab0b-b29d29f85ff9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:01.106224 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af63fd1-4e09-47b9-b532-62da1a362e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:01.106914 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af63fd1-4e09-47b9-b532-62da1a362e2b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.107193 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af63fd1-4e09-47b9-b532-62da1a362e2b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.107464 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af63fd1-4e09-47b9-b532-62da1a362e2b None admin] PATH_INFO: `/v3/services/image` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.108172 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af63fd1-4e09-47b9-b532-62da1a362e2b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:01.109683 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af63fd1-4e09-47b9-b532-62da1a362e2b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-9af63fd1-4e09-47b9-b532-62da1a362e2b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:01.119607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:01.120639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:01.126539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 363/727] 10.222.0.52 () {56 vars in 1105 bytes} [Sat Sep 17 20:39:00 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:01.130906 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af63fd1-4e09-47b9-b532-62da1a362e2b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:01.147835 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:01.155982 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be08bd-4b6f-442e-a765-1853919b6908 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:01.195907 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b044d7-babc-487d-b8ae-fb55a7da5b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:01.196904 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b044d7-babc-487d-b8ae-fb55a7da5b9e None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.198108 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b044d7-babc-487d-b8ae-fb55a7da5b9e None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.198687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b044d7-babc-487d-b8ae-fb55a7da5b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.199644 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b044d7-babc-487d-b8ae-fb55a7da5b9e None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=9674e78b7a6b41eb8a00aefff4cd22c1) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:01.200179 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b044d7-babc-487d-b8ae-fb55a7da5b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:01.202071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b044d7-babc-487d-b8ae-fb55a7da5b9e None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:01.209275 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 365/728] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:39:01 2022] GET /identity/v3/role_assignments?user.id=9674e78b7a6b41eb8a00aefff4cd22c1&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:01.260926 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af63fd1-4e09-47b9-b532-62da1a362e2b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:01.301729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bda4c5-99f2-4bdb-8128-1e2fbfbb3e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:01.302341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bda4c5-99f2-4bdb-8128-1e2fbfbb3e0a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.302619 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bda4c5-99f2-4bdb-8128-1e2fbfbb3e0a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.302894 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bda4c5-99f2-4bdb-8128-1e2fbfbb3e0a None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.303543 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bda4c5-99f2-4bdb-8128-1e2fbfbb3e0a None admin] RBAC: Adding query filter params (name=image) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:01.303847 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bda4c5-99f2-4bdb-8128-1e2fbfbb3e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:01.305404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bda4c5-99f2-4bdb-8128-1e2fbfbb3e0a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:01.311079 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 364/729] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:39:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:01.316766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b044d7-babc-487d-b8ae-fb55a7da5b9e None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:01.394979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:01.433100 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b044d7-babc-487d-b8ae-fb55a7da5b9e None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:01.469465 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb373e-7a46-4a95-9ba1-9b2be757b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:01.469996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb373e-7a46-4a95-9ba1-9b2be757b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.470272 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb373e-7a46-4a95-9ba1-9b2be757b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.470538 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb373e-7a46-4a95-9ba1-9b2be757b2a6 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.471163 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb373e-7a46-4a95-9ba1-9b2be757b2a6 None admin] RBAC: Adding query filter params (type=image) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:01.471462 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb373e-7a46-4a95-9ba1-9b2be757b2a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:01.472829 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb373e-7a46-4a95-9ba1-9b2be757b2a6 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:01.479060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 366/730] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:39:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:01.484634 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bda4c5-99f2-4bdb-8128-1e2fbfbb3e0a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:01.568844 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:01.592934 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bda4c5-99f2-4bdb-8128-1e2fbfbb3e0a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:01.626430 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b20fc-4de2-4fc6-8ab7-9ce9239f1bb1 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.626939 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b20fc-4de2-4fc6-8ab7-9ce9239f1bb1 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.626939 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b20fc-4de2-4fc6-8ab7-9ce9239f1bb1 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.628572 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 367/731] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:01.628833 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06939100-56af-4aad-adcb-b9f56e46aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:01.629479 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06939100-56af-4aad-adcb-b9f56e46aab5 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.629770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06939100-56af-4aad-adcb-b9f56e46aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.630018 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06939100-56af-4aad-adcb-b9f56e46aab5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.630696 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06939100-56af-4aad-adcb-b9f56e46aab5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:01.632583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06939100-56af-4aad-adcb-b9f56e46aab5 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:01.633773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b524c8c-0393-4aff-bf37-613d13546a16 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.634061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b524c8c-0393-4aff-bf37-613d13546a16 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.634339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b524c8c-0393-4aff-bf37-613d13546a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.653778 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-1b524c8c-0393-4aff-bf37-613d13546a16 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:01.655012 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-1b524c8c-0393-4aff-bf37-613d13546a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:01.708667 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 365/732] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:39:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:39:01.709996 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1860b-9382-4a64-a5f3-0ec7e1382e4f None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.710281 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1860b-9382-4a64-a5f3-0ec7e1382e4f None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.711077 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1860b-9382-4a64-a5f3-0ec7e1382e4f None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.712474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 366/733] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:01.718146 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7095a-fe94-4183-be4b-2be624eae2c5 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:01.718427 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7095a-fe94-4183-be4b-2be624eae2c5 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:01.718700 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7095a-fe94-4183-be4b-2be624eae2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:01.745542 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-4ef7095a-fe94-4183-be4b-2be624eae2c5 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:01.745542 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-4ef7095a-fe94-4183-be4b-2be624eae2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:01.745821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 368/734] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:01 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 20:39:01.828007 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 367/735] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:01 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 20:39:02.088876 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b524c8c-0393-4aff-bf37-613d13546a16 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:02.153759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:02.172032 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7095a-fe94-4183-be4b-2be624eae2c5 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:02.203864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b524c8c-0393-4aff-bf37-613d13546a16 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:02.249599 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:02.249797 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f8b78-bdae-439a-a9f4-61b536d8e8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:02.250234 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f8b78-bdae-439a-a9f4-61b536d8e8c1 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:02.250564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f8b78-bdae-439a-a9f4-61b536d8e8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:02.250784 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f8b78-bdae-439a-a9f4-61b536d8e8c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:02.253676 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f8b78-bdae-439a-a9f4-61b536d8e8c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:02.255049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f8b78-bdae-439a-a9f4-61b536d8e8c1 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-108f8b78-bdae-439a-a9f4-61b536d8e8c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:02.268592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:02.269773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 20:39:02.270627 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:02.271359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 369/736] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:39:02 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:02.276943 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f8b78-bdae-439a-a9f4-61b536d8e8c1 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:02.299170 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7095a-fe94-4183-be4b-2be624eae2c5 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:02.343311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ac06c-04b8-44a6-bd3f-4046653ab83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:02.343859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ac06c-04b8-44a6-bd3f-4046653ab83a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:02.344138 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ac06c-04b8-44a6-bd3f-4046653ab83a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:02.344409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ac06c-04b8-44a6-bd3f-4046653ab83a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:02.345096 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ac06c-04b8-44a6-bd3f-4046653ab83a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:02.346653 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ac06c-04b8-44a6-bd3f-4046653ab83a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-413ac06c-04b8-44a6-bd3f-4046653ab83a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:02.356065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:02.357037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:02.362305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 368/737] 10.222.0.52 () {56 vars in 1129 bytes} [Sat Sep 17 20:39:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:02.364036 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ac06c-04b8-44a6-bd3f-4046653ab83a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:02.406414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f8b78-bdae-439a-a9f4-61b536d8e8c1 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:02.434040 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:02.447524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b013825-7b17-4159-ad26-b659b3964881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:02.448181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b013825-7b17-4159-ad26-b659b3964881 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:02.448460 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b013825-7b17-4159-ad26-b659b3964881 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:02.448734 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b013825-7b17-4159-ad26-b659b3964881 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:02.449416 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b013825-7b17-4159-ad26-b659b3964881 None admin] RBAC: Adding query filter params (name=network) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:02.449720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b013825-7b17-4159-ad26-b659b3964881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:02.451237 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b013825-7b17-4159-ad26-b659b3964881 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:02.456789 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 370/738] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:39:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:39:02.462662 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b013825-7b17-4159-ad26-b659b3964881 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:02.492343 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ac06c-04b8-44a6-bd3f-4046653ab83a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:02.526285 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:02.539650 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adb91d-589f-419f-b5ea-cfcba774501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:02.540490 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adb91d-589f-419f-b5ea-cfcba774501a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:02.540936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adb91d-589f-419f-b5ea-cfcba774501a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:02.541384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adb91d-589f-419f-b5ea-cfcba774501a None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:02.542302 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adb91d-589f-419f-b5ea-cfcba774501a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:02.543274 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adb91d-589f-419f-b5ea-cfcba774501a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:02.545151 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adb91d-589f-419f-b5ea-cfcba774501a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:02.556185 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 369/739] 10.222.0.52 () {56 vars in 1124 bytes} [Sat Sep 17 20:39:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:02.556709 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adb91d-589f-419f-b5ea-cfcba774501a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:02.592210 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b013825-7b17-4159-ad26-b659b3964881 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:02.636872 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33cc2-a6e1-4cc7-b143-b47fee83c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:02.638390 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33cc2-a6e1-4cc7-b143-b47fee83c268 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:02.638909 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33cc2-a6e1-4cc7-b143-b47fee83c268 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:02.639352 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33cc2-a6e1-4cc7-b143-b47fee83c268 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:02.640538 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33cc2-a6e1-4cc7-b143-b47fee83c268 None admin] RBAC: Adding query filter params (type=network) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:02.641016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33cc2-a6e1-4cc7-b143-b47fee83c268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:02.642920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33cc2-a6e1-4cc7-b143-b47fee83c268 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:02.650446 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 371/740] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:39:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:39:02.655613 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33cc2-a6e1-4cc7-b143-b47fee83c268 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:02.672645 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adb91d-589f-419f-b5ea-cfcba774501a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:02.711723 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6382b4f-2bb1-44d8-9c32-a2c0ec292d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:02.712053 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6382b4f-2bb1-44d8-9c32-a2c0ec292d63 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:02.712279 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6382b4f-2bb1-44d8-9c32-a2c0ec292d63 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:02.712554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6382b4f-2bb1-44d8-9c32-a2c0ec292d63 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:02.713334 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6382b4f-2bb1-44d8-9c32-a2c0ec292d63 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:02.713647 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6382b4f-2bb1-44d8-9c32-a2c0ec292d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:02.715016 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6382b4f-2bb1-44d8-9c32-a2c0ec292d63 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:02.725385 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 370/741] 10.222.0.52 () {56 vars in 1124 bytes} [Sat Sep 17 20:39:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:02.727027 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6382b4f-2bb1-44d8-9c32-a2c0ec292d63 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:02.732956 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:02.789525 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:02.804031 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33cc2-a6e1-4cc7-b143-b47fee83c268 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:02.850418 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bede7d9-643d-4363-87bc-520609430c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:02.850646 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6382b4f-2bb1-44d8-9c32-a2c0ec292d63 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:02.852018 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bede7d9-643d-4363-87bc-520609430c98 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:02.852522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bede7d9-643d-4363-87bc-520609430c98 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:02.853228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bede7d9-643d-4363-87bc-520609430c98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:02.854990 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bede7d9-643d-4363-87bc-520609430c98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:02.856610 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bede7d9-643d-4363-87bc-520609430c98 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:02.888490 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11c2f9-b1f3-430c-ab15-62180ed0b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:02.889102 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11c2f9-b1f3-430c-ab15-62180ed0b637 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:02.889412 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11c2f9-b1f3-430c-ab15-62180ed0b637 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:02.889690 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11c2f9-b1f3-430c-ab15-62180ed0b637 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:02.890357 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11c2f9-b1f3-430c-ab15-62180ed0b637 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:02.891747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11c2f9-b1f3-430c-ab15-62180ed0b637 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:02.946584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 372/742] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:39:02 2022] POST /identity/v3/endpoints => generated 337 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:39:02.981438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 371/743] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:39:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:39:03.808600 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7592dd-75c0-4ec4-b8c1-7ed4e80e41b6 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:03.808600 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7592dd-75c0-4ec4-b8c1-7ed4e80e41b6 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:03.808600 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7592dd-75c0-4ec4-b8c1-7ed4e80e41b6 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:03.809563 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 373/744] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:03.815447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec7e9a-7117-4925-bb09-8dfd8ef3a20d None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:03.815447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec7e9a-7117-4925-bb09-8dfd8ef3a20d None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:03.815873 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec7e9a-7117-4925-bb09-8dfd8ef3a20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:03.837452 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-1aec7e9a-7117-4925-bb09-8dfd8ef3a20d None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:03.838712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-1aec7e9a-7117-4925-bb09-8dfd8ef3a20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:03.914179 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 372/745] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:03 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:04.246828 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7592dd-75c0-4ec4-b8c1-7ed4e80e41b6 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:04.251378 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6900c71-573c-4a43-bd7c-d52b53869f65 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:04.251659 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6900c71-573c-4a43-bd7c-d52b53869f65 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:04.251953 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6900c71-573c-4a43-bd7c-d52b53869f65 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:04.253300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 373/746] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:04.258962 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42a4f9-59d9-4051-bc48-c85790298362 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:04.259240 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42a4f9-59d9-4051-bc48-c85790298362 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:04.259515 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42a4f9-59d9-4051-bc48-c85790298362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:04.278536 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-bc42a4f9-59d9-4051-bc48-c85790298362 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:04.279734 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-bc42a4f9-59d9-4051-bc48-c85790298362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:04.309662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:04.350003 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 374/747] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:04 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:04.362951 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7592dd-75c0-4ec4-b8c1-7ed4e80e41b6 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:04.370423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:04.398632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0b5d8-a181-45f1-8bc6-76feecbaf06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:04.400236 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b5d8-a181-45f1-8bc6-76feecbaf06f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:04.400236 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b5d8-a181-45f1-8bc6-76feecbaf06f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:04.400236 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b5d8-a181-45f1-8bc6-76feecbaf06f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:04.400698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0b5d8-a181-45f1-8bc6-76feecbaf06f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:04.402021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0b5d8-a181-45f1-8bc6-76feecbaf06f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-1eb0b5d8-a181-45f1-8bc6-76feecbaf06f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:04.410721 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:04.411673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 20:39:04.413060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:04.418929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 374/748] 10.222.0.52 () {56 vars in 1132 bytes} [Sat Sep 17 20:39:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:04.419024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42a4f9-59d9-4051-bc48-c85790298362 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:04.517867 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42a4f9-59d9-4051-bc48-c85790298362 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:04.554483 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1bf7f-c0ae-4769-99ba-34625d4dda12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:04.555190 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1bf7f-c0ae-4769-99ba-34625d4dda12 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:04.555458 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1bf7f-c0ae-4769-99ba-34625d4dda12 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:04.555677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1bf7f-c0ae-4769-99ba-34625d4dda12 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:04.556294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1bf7f-c0ae-4769-99ba-34625d4dda12 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:04.556591 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1bf7f-c0ae-4769-99ba-34625d4dda12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:04.557956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1bf7f-c0ae-4769-99ba-34625d4dda12 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:04.562619 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 375/749] 10.222.0.52 () {56 vars in 1126 bytes} [Sat Sep 17 20:39:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:04.568583 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0b5d8-a181-45f1-8bc6-76feecbaf06f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:04.672492 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0b5d8-a181-45f1-8bc6-76feecbaf06f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:04.673423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1bf7f-c0ae-4769-99ba-34625d4dda12 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:04.709099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b2e44-5908-4d31-ab1f-c20066fa2439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:04.709426 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:04.710062 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b2e44-5908-4d31-ab1f-c20066fa2439 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:04.710340 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b2e44-5908-4d31-ab1f-c20066fa2439 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:04.711310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b2e44-5908-4d31-ab1f-c20066fa2439 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:04.712051 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b2e44-5908-4d31-ab1f-c20066fa2439 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:04.712236 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b2e44-5908-4d31-ab1f-c20066fa2439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:04.713643 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b2e44-5908-4d31-ab1f-c20066fa2439 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:04.718055 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 375/750] 10.222.0.52 () {56 vars in 1126 bytes} [Sat Sep 17 20:39:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:39:04.788043 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1bf7f-c0ae-4769-99ba-34625d4dda12 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:04.834759 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2d5b1-0ab2-44c7-99fe-0db87101e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:04.835969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2d5b1-0ab2-44c7-99fe-0db87101e88d None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:04.839899 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2d5b1-0ab2-44c7-99fe-0db87101e88d None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:04.840219 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2d5b1-0ab2-44c7-99fe-0db87101e88d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:04.915182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2d5b1-0ab2-44c7-99fe-0db87101e88d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:04.916646 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2d5b1-0ab2-44c7-99fe-0db87101e88d None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:04.947755 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:05.026208 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 376/751] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:39:04 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 20:39:05.031568 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b2e44-5908-4d31-ab1f-c20066fa2439 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:05.069423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:05.146927 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b2e44-5908-4d31-ab1f-c20066fa2439 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:05.180774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d00a13-e58a-4f0e-bba1-7045e16a6db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:05.181431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d00a13-e58a-4f0e-bba1-7045e16a6db3 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:05.181708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d00a13-e58a-4f0e-bba1-7045e16a6db3 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:05.181979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d00a13-e58a-4f0e-bba1-7045e16a6db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:05.192859 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d00a13-e58a-4f0e-bba1-7045e16a6db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:05.194596 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d00a13-e58a-4f0e-bba1-7045e16a6db3 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-d5d00a13-e58a-4f0e-bba1-7045e16a6db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:39:05.209629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:05.211233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:39:05.212414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:39:05.212414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:39:05.212414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:05.213378 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 376/752] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:05.217408 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2d5b1-0ab2-44c7-99fe-0db87101e88d None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:05.318661 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2d5b1-0ab2-44c7-99fe-0db87101e88d None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:05.348255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:05.354761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0fa8-6841-4ff2-9be0-8affbeb73ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:05.361356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0fa8-6841-4ff2-9be0-8affbeb73ac9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:05.361356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0fa8-6841-4ff2-9be0-8affbeb73ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:05.361356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0fa8-6841-4ff2-9be0-8affbeb73ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:05.361356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0fa8-6841-4ff2-9be0-8affbeb73ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:05.361356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0fa8-6841-4ff2-9be0-8affbeb73ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:05.361356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0fa8-6841-4ff2-9be0-8affbeb73ac9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:05.377199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 377/753] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:05.535677 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e27d-a0d1-46f6-8a10-fb9148dbbe46 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:05.536034 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e27d-a0d1-46f6-8a10-fb9148dbbe46 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:05.536225 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e27d-a0d1-46f6-8a10-fb9148dbbe46 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:05.537781 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 377/754] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:05.544160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd43de-9b40-441f-8914-5810993cfe15 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:05.544470 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd43de-9b40-441f-8914-5810993cfe15 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:05.544725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd43de-9b40-441f-8914-5810993cfe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:05.563893 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-94fd43de-9b40-441f-8914-5810993cfe15 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:05.565130 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-94fd43de-9b40-441f-8914-5810993cfe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:05.639037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 378/755] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:05 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:05.970302 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e27d-a0d1-46f6-8a10-fb9148dbbe46 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:06.055136 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:06.070821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e27d-a0d1-46f6-8a10-fb9148dbbe46 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:06.104186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269857-ab97-4301-a75a-da8c07f07648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:06.104812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269857-ab97-4301-a75a-da8c07f07648 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:06.105092 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269857-ab97-4301-a75a-da8c07f07648 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:06.105389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269857-ab97-4301-a75a-da8c07f07648 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:06.105959 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18269857-ab97-4301-a75a-da8c07f07648 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:06.107352 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18269857-ab97-4301-a75a-da8c07f07648 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-18269857-ab97-4301-a75a-da8c07f07648 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:06.115966 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:06.117648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:06.118476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 378/756] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:39:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:06.123526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd43de-9b40-441f-8914-5810993cfe15 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:06.224502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd43de-9b40-441f-8914-5810993cfe15 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:06.244004 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:06.257902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39a5b3-7341-48de-ac25-4e2e914eaa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:06.258607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39a5b3-7341-48de-ac25-4e2e914eaa46 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:06.258890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39a5b3-7341-48de-ac25-4e2e914eaa46 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:06.259165 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39a5b3-7341-48de-ac25-4e2e914eaa46 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:06.259786 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39a5b3-7341-48de-ac25-4e2e914eaa46 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:06.260088 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39a5b3-7341-48de-ac25-4e2e914eaa46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:06.261466 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39a5b3-7341-48de-ac25-4e2e914eaa46 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:06.265800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 379/757] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:39:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:06.271403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269857-ab97-4301-a75a-da8c07f07648 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:06.368204 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269857-ab97-4301-a75a-da8c07f07648 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:06.401056 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd928b-0180-4a95-99cf-cc201fc685dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:06.401983 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd928b-0180-4a95-99cf-cc201fc685dc None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:06.402264 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd928b-0180-4a95-99cf-cc201fc685dc None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:06.402537 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd928b-0180-4a95-99cf-cc201fc685dc None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:06.403160 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd928b-0180-4a95-99cf-cc201fc685dc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:06.403461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd928b-0180-4a95-99cf-cc201fc685dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:06.404823 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd928b-0180-4a95-99cf-cc201fc685dc None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:06.417204 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 379/758] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:39:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:07.145577 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a8d69-7847-4991-b892-05e099c91fba None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:07.146108 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a8d69-7847-4991-b892-05e099c91fba None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:07.146108 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a8d69-7847-4991-b892-05e099c91fba None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:07.147423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 380/759] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:07.153340 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617c5ae-ec3d-4749-972c-608ece9f2540 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:07.153768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617c5ae-ec3d-4749-972c-608ece9f2540 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:07.153883 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617c5ae-ec3d-4749-972c-608ece9f2540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:07.172363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-9617c5ae-ec3d-4749-972c-608ece9f2540 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:07.173569 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-9617c5ae-ec3d-4749-972c-608ece9f2540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:07.182784 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:07.238661 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 380/760] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:07 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 20:39:07.564945 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a8d69-7847-4991-b892-05e099c91fba None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:07.665091 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a8d69-7847-4991-b892-05e099c91fba None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:07.698009 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52c4e-0411-4682-b4cf-ff43829129cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:07.698597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52c4e-0411-4682-b4cf-ff43829129cc None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:07.698872 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52c4e-0411-4682-b4cf-ff43829129cc None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:07.699138 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52c4e-0411-4682-b4cf-ff43829129cc None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:07.699773 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52c4e-0411-4682-b4cf-ff43829129cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:07.701117 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52c4e-0411-4682-b4cf-ff43829129cc None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:07.779822 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 381/761] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:39:07 2022] POST /identity/v3/services => generated 269 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:39:08.895454 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db16bd-44a4-44c4-b8ed-d0c63adddebc None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:08.896024 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db16bd-44a4-44c4-b8ed-d0c63adddebc None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:08.896024 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db16bd-44a4-44c4-b8ed-d0c63adddebc None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:08.897410 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 381/762] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:08.903308 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7144a2-0c1b-4777-b157-3e55a54bdf79 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:08.903782 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7144a2-0c1b-4777-b157-3e55a54bdf79 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:08.903977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7144a2-0c1b-4777-b157-3e55a54bdf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:08.923018 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-5a7144a2-0c1b-4777-b157-3e55a54bdf79 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:08.924186 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-5a7144a2-0c1b-4777-b157-3e55a54bdf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:08.964580 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:08.997657 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 382/763] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:08 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:09.334100 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db16bd-44a4-44c4-b8ed-d0c63adddebc None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:09.438276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db16bd-44a4-44c4-b8ed-d0c63adddebc None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:09.472585 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f094974-f1f7-479d-b346-395a6d5882e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:09.473217 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f094974-f1f7-479d-b346-395a6d5882e4 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:09.473498 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f094974-f1f7-479d-b346-395a6d5882e4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:09.473766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f094974-f1f7-479d-b346-395a6d5882e4 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:09.474473 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f094974-f1f7-479d-b346-395a6d5882e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:09.475865 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f094974-f1f7-479d-b346-395a6d5882e4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:09.562166 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 382/764] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:39:09 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:39:10.303618 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296675-6369-42c7-9a8f-4219462f6312 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:10.304243 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296675-6369-42c7-9a8f-4219462f6312 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:10.304347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296675-6369-42c7-9a8f-4219462f6312 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:10.305690 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 383/765] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:10.311029 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d428a19-caea-41a1-989c-ea68475195fa None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:10.311457 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d428a19-caea-41a1-989c-ea68475195fa None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:10.311565 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d428a19-caea-41a1-989c-ea68475195fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:10.319599 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:10.330988 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-6d428a19-caea-41a1-989c-ea68475195fa None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:10.332176 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-6d428a19-caea-41a1-989c-ea68475195fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:10.405278 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 383/766] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:10 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:10.737121 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff296675-6369-42c7-9a8f-4219462f6312 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:10.839642 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff296675-6369-42c7-9a8f-4219462f6312 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:10.872962 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ece4-c5de-4d0f-ba54-2677eef2c385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:10.873612 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ece4-c5de-4d0f-ba54-2677eef2c385 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:10.873890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ece4-c5de-4d0f-ba54-2677eef2c385 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:10.874162 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ece4-c5de-4d0f-ba54-2677eef2c385 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:10.874743 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ece4-c5de-4d0f-ba54-2677eef2c385 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:10.876102 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ece4-c5de-4d0f-ba54-2677eef2c385 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-def2ece4-c5de-4d0f-ba54-2677eef2c385 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:10.885572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:10.886654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:10.887699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 384/767] 10.222.0.52 () {56 vars in 1132 bytes} [Sat Sep 17 20:39:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:10.892589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d428a19-caea-41a1-989c-ea68475195fa None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:10.987053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d428a19-caea-41a1-989c-ea68475195fa None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:11.014192 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:11.019648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaad0e9-02a2-402b-937c-3a26548bea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:11.020241 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaad0e9-02a2-402b-937c-3a26548bea10 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:11.020522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaad0e9-02a2-402b-937c-3a26548bea10 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:11.020802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaad0e9-02a2-402b-937c-3a26548bea10 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:11.021436 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaad0e9-02a2-402b-937c-3a26548bea10 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:11.021737 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaad0e9-02a2-402b-937c-3a26548bea10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:11.023134 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaad0e9-02a2-402b-937c-3a26548bea10 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:11.027811 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 384/768] 10.222.0.52 () {56 vars in 1126 bytes} [Sat Sep 17 20:39:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:11.033424 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ece4-c5de-4d0f-ba54-2677eef2c385 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:11.072333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:11.140602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ece4-c5de-4d0f-ba54-2677eef2c385 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:11.173681 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741a8e-a2f7-4be3-b40b-2367a0fc4cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:11.174274 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741a8e-a2f7-4be3-b40b-2367a0fc4cf2 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:11.174551 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741a8e-a2f7-4be3-b40b-2367a0fc4cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:11.174823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741a8e-a2f7-4be3-b40b-2367a0fc4cf2 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:11.175440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06741a8e-a2f7-4be3-b40b-2367a0fc4cf2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:11.175769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06741a8e-a2f7-4be3-b40b-2367a0fc4cf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:11.177120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06741a8e-a2f7-4be3-b40b-2367a0fc4cf2 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:11.182526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 385/769] 10.222.0.52 () {56 vars in 1126 bytes} [Sat Sep 17 20:39:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:11.188411 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaad0e9-02a2-402b-937c-3a26548bea10 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:11.287817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaad0e9-02a2-402b-937c-3a26548bea10 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:11.322175 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a945198-ad41-4f1a-9c05-953d97ad69f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:11.322757 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a945198-ad41-4f1a-9c05-953d97ad69f2 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:11.323043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a945198-ad41-4f1a-9c05-953d97ad69f2 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:11.323407 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a945198-ad41-4f1a-9c05-953d97ad69f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:11.324103 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a945198-ad41-4f1a-9c05-953d97ad69f2 None admin] RBAC: Adding query filter params (interface=public, service_id=04f25e29958142be865e100e0865d312, region_id=RegionOne) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:11.324410 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a945198-ad41-4f1a-9c05-953d97ad69f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:11.325789 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a945198-ad41-4f1a-9c05-953d97ad69f2 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:11.330653 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 385/770] 10.222.0.52 () {56 vars in 1251 bytes} [Sat Sep 17 20:39:11 2022] GET /identity/v3/endpoints?service_id=04f25e29958142be865e100e0865d312&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:39:11.337275 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741a8e-a2f7-4be3-b40b-2367a0fc4cf2 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:11.434146 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:11.437566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741a8e-a2f7-4be3-b40b-2367a0fc4cf2 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:11.471629 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfcf4a-a62c-4b01-ae2e-3875859f72bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:11.472221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfcf4a-a62c-4b01-ae2e-3875859f72bc None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:11.472499 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfcf4a-a62c-4b01-ae2e-3875859f72bc None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:11.472771 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfcf4a-a62c-4b01-ae2e-3875859f72bc None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:11.473390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfcf4a-a62c-4b01-ae2e-3875859f72bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:11.474749 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfcf4a-a62c-4b01-ae2e-3875859f72bc None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:11.481018 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 386/771] 10.222.0.52 () {56 vars in 1087 bytes} [Sat Sep 17 20:39:11 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:39:12.040135 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec994aa8-9740-4088-808e-16fc4895d5aa None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:12.040445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec994aa8-9740-4088-808e-16fc4895d5aa None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:12.040665 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec994aa8-9740-4088-808e-16fc4895d5aa None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:12.042171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 386/772] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:12.047489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47b2b-92a5-4371-99b7-741010766868 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:12.047774 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47b2b-92a5-4371-99b7-741010766868 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:12.048048 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47b2b-92a5-4371-99b7-741010766868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:12.066094 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-7ff47b2b-92a5-4371-99b7-741010766868 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:12.067218 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-7ff47b2b-92a5-4371-99b7-741010766868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:12.135219 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 387/773] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:12.462505 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec994aa8-9740-4088-808e-16fc4895d5aa None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:12.522834 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:12.564524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec994aa8-9740-4088-808e-16fc4895d5aa None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:12.600008 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816e743-acd6-4155-9ce2-1b529df2e351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:12.600636 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816e743-acd6-4155-9ce2-1b529df2e351 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:12.600912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816e743-acd6-4155-9ce2-1b529df2e351 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:12.601278 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816e743-acd6-4155-9ce2-1b529df2e351 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:12.601946 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816e743-acd6-4155-9ce2-1b529df2e351 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:12.603310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816e743-acd6-4155-9ce2-1b529df2e351 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-a816e743-acd6-4155-9ce2-1b529df2e351 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:12.611957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:12.612893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 20:39:12.613756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:12.614933 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 387/774] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:39:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:39:12.619929 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff47b2b-92a5-4371-99b7-741010766868 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:12.708226 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:12.719264 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff47b2b-92a5-4371-99b7-741010766868 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:12.751068 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851019c6-c3e0-4ae3-a266-12c2e02676ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:12.751671 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851019c6-c3e0-4ae3-a266-12c2e02676ef None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:12.751949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851019c6-c3e0-4ae3-a266-12c2e02676ef None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:12.752220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851019c6-c3e0-4ae3-a266-12c2e02676ef None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:12.752846 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851019c6-c3e0-4ae3-a266-12c2e02676ef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:12.753145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851019c6-c3e0-4ae3-a266-12c2e02676ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:12.754523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851019c6-c3e0-4ae3-a266-12c2e02676ef None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:12.759702 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 388/775] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:39:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:12.765312 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816e743-acd6-4155-9ce2-1b529df2e351 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:12.866290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816e743-acd6-4155-9ce2-1b529df2e351 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:12.887958 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:12.899415 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a403dd-1a1a-4cc4-bd97-3ef3e44aaba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:12.900028 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a403dd-1a1a-4cc4-bd97-3ef3e44aaba7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:12.906174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a403dd-1a1a-4cc4-bd97-3ef3e44aaba7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:12.906174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a403dd-1a1a-4cc4-bd97-3ef3e44aaba7 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:12.906174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a403dd-1a1a-4cc4-bd97-3ef3e44aaba7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:12.906174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a403dd-1a1a-4cc4-bd97-3ef3e44aaba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:12.906174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a403dd-1a1a-4cc4-bd97-3ef3e44aaba7 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:12.907661 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 388/776] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:39:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:12.914192 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851019c6-c3e0-4ae3-a266-12c2e02676ef None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:13.010393 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851019c6-c3e0-4ae3-a266-12c2e02676ef None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:13.043782 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60873d1a-5292-4788-ad3c-7741ac01eba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:13.044396 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60873d1a-5292-4788-ad3c-7741ac01eba5 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:13.044679 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60873d1a-5292-4788-ad3c-7741ac01eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:13.044948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60873d1a-5292-4788-ad3c-7741ac01eba5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:13.045663 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60873d1a-5292-4788-ad3c-7741ac01eba5 None admin] RBAC: Adding query filter params (interface=public, service_id=f226a5e377d84242a88b0508ad7c53e5, region_id=RegionOne) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:13.045968 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60873d1a-5292-4788-ad3c-7741ac01eba5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:13.047314 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60873d1a-5292-4788-ad3c-7741ac01eba5 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:13.052136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 389/777] 10.222.0.52 () {56 vars in 1251 bytes} [Sat Sep 17 20:39:12 2022] GET /identity/v3/endpoints?service_id=f226a5e377d84242a88b0508ad7c53e5&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:39:13.057785 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a403dd-1a1a-4cc4-bd97-3ef3e44aaba7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:13.165072 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a403dd-1a1a-4cc4-bd97-3ef3e44aaba7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:13.198186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774c93-6a62-4642-9392-28411107566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:13.198794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774c93-6a62-4642-9392-28411107566c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:13.199075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774c93-6a62-4642-9392-28411107566c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:13.199349 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774c93-6a62-4642-9392-28411107566c None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:13.199946 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774c93-6a62-4642-9392-28411107566c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:13.201349 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774c93-6a62-4642-9392-28411107566c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:13.207142 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 389/778] 10.222.0.52 () {56 vars in 1087 bytes} [Sat Sep 17 20:39:13 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 20:39:13.972509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c2ed0-ae78-4c8a-873c-2ef470f8d691 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:13.973076 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c2ed0-ae78-4c8a-873c-2ef470f8d691 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:13.973196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c2ed0-ae78-4c8a-873c-2ef470f8d691 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:13.974523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 390/779] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:13.980357 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e1e0c-e7d6-453c-be0d-10f22c450f56 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:13.980792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e1e0c-e7d6-453c-be0d-10f22c450f56 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:13.980910 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e1e0c-e7d6-453c-be0d-10f22c450f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:13.999815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-f14e1e0c-e7d6-453c-be0d-10f22c450f56 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:14.000993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-f14e1e0c-e7d6-453c-be0d-10f22c450f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:14.046926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:14.066443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 390/780] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:13 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:14.396839 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c2ed0-ae78-4c8a-873c-2ef470f8d691 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:14.421217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:14.504726 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c2ed0-ae78-4c8a-873c-2ef470f8d691 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:14.538572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178439-f89c-42ce-819b-468747cad82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:14.539197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178439-f89c-42ce-819b-468747cad82e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:14.539472 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178439-f89c-42ce-819b-468747cad82e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:14.539742 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178439-f89c-42ce-819b-468747cad82e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:14.540317 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178439-f89c-42ce-819b-468747cad82e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:14.541715 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178439-f89c-42ce-819b-468747cad82e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-f1178439-f89c-42ce-819b-468747cad82e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:14.553936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:14.555616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:14.556496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 391/781] 10.222.0.52 () {56 vars in 1132 bytes} [Sat Sep 17 20:39:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:14.562109 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e1e0c-e7d6-453c-be0d-10f22c450f56 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:14.664957 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e1e0c-e7d6-453c-be0d-10f22c450f56 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:14.697126 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a984a8-fbd8-4ca2-ae4b-b2161240266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:14.697742 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a984a8-fbd8-4ca2-ae4b-b2161240266a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:14.698020 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a984a8-fbd8-4ca2-ae4b-b2161240266a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:14.698290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a984a8-fbd8-4ca2-ae4b-b2161240266a None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:14.698901 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a984a8-fbd8-4ca2-ae4b-b2161240266a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:14.699200 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a984a8-fbd8-4ca2-ae4b-b2161240266a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:14.700556 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a984a8-fbd8-4ca2-ae4b-b2161240266a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:14.705043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 391/782] 10.222.0.52 () {56 vars in 1126 bytes} [Sat Sep 17 20:39:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:14.711282 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178439-f89c-42ce-819b-468747cad82e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:14.793308 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:14.811344 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178439-f89c-42ce-819b-468747cad82e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:14.842122 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f7964-39d2-4ba8-966f-4e42290cdccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:14.842713 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f7964-39d2-4ba8-966f-4e42290cdccf None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:14.842989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f7964-39d2-4ba8-966f-4e42290cdccf None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:14.843258 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f7964-39d2-4ba8-966f-4e42290cdccf None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:14.843879 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f7964-39d2-4ba8-966f-4e42290cdccf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:14.844181 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f7964-39d2-4ba8-966f-4e42290cdccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:14.845560 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f7964-39d2-4ba8-966f-4e42290cdccf None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:14.850238 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 392/783] 10.222.0.52 () {56 vars in 1126 bytes} [Sat Sep 17 20:39:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:14.856438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a984a8-fbd8-4ca2-ae4b-b2161240266a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:14.900687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:14.955719 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a984a8-fbd8-4ca2-ae4b-b2161240266a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:14.989998 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0ae1f-2907-455a-8cda-ebab70af9ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:14.990641 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0ae1f-2907-455a-8cda-ebab70af9ba4 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:14.990867 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0ae1f-2907-455a-8cda-ebab70af9ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:14.991138 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0ae1f-2907-455a-8cda-ebab70af9ba4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:14.992419 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0ae1f-2907-455a-8cda-ebab70af9ba4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:14.993805 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0ae1f-2907-455a-8cda-ebab70af9ba4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:15.077202 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 392/784] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:39:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:39:15.644479 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02694c4a-f575-4b98-b66f-3a5af034d32f None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:15.645029 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02694c4a-f575-4b98-b66f-3a5af034d32f None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:15.645029 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02694c4a-f575-4b98-b66f-3a5af034d32f None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:15.646384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 393/785] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:15.652544 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0286-c6a6-4f77-b623-24ddbfe61c26 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:15.657544 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0286-c6a6-4f77-b623-24ddbfe61c26 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:15.657544 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0286-c6a6-4f77-b623-24ddbfe61c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:15.671143 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-c84e0286-c6a6-4f77-b623-24ddbfe61c26 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:15.672331 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-c84e0286-c6a6-4f77-b623-24ddbfe61c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:15.745345 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 393/786] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:15 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:16.070202 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02694c4a-f575-4b98-b66f-3a5af034d32f None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:16.171741 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02694c4a-f575-4b98-b66f-3a5af034d32f None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:16.204677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d46b6-6554-4615-81fd-59f4f478e5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:16.205329 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d46b6-6554-4615-81fd-59f4f478e5f8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:16.205610 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d46b6-6554-4615-81fd-59f4f478e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:16.205904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d46b6-6554-4615-81fd-59f4f478e5f8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:16.206481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d46b6-6554-4615-81fd-59f4f478e5f8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:16.207853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d46b6-6554-4615-81fd-59f4f478e5f8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-f61d46b6-6554-4615-81fd-59f4f478e5f8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:16.217012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:16.218001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:16.218831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 394/787] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:39:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:16.223964 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e0286-c6a6-4f77-b623-24ddbfe61c26 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:16.250411 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:16.322417 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e0286-c6a6-4f77-b623-24ddbfe61c26 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:16.356390 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b664-f876-47f6-a73f-735acfaf1863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:16.356996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b664-f876-47f6-a73f-735acfaf1863 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:16.357311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b664-f876-47f6-a73f-735acfaf1863 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:16.357586 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b664-f876-47f6-a73f-735acfaf1863 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:16.358217 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b664-f876-47f6-a73f-735acfaf1863 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:16.358518 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b664-f876-47f6-a73f-735acfaf1863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:16.359887 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b664-f876-47f6-a73f-735acfaf1863 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:16.364475 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 394/788] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:39:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:16.370496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d46b6-6554-4615-81fd-59f4f478e5f8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:16.386616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:16.472536 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d46b6-6554-4615-81fd-59f4f478e5f8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:16.507401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865beb26-77ea-48b5-8f93-f4d4c8f1d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:16.508532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865beb26-77ea-48b5-8f93-f4d4c8f1d634 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:16.508807 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865beb26-77ea-48b5-8f93-f4d4c8f1d634 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:16.509073 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865beb26-77ea-48b5-8f93-f4d4c8f1d634 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:16.509728 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865beb26-77ea-48b5-8f93-f4d4c8f1d634 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:16.510028 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865beb26-77ea-48b5-8f93-f4d4c8f1d634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:16.511382 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865beb26-77ea-48b5-8f93-f4d4c8f1d634 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:16.516106 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 395/789] 10.222.0.52 () {56 vars in 1114 bytes} [Sat Sep 17 20:39:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:16.521732 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b664-f876-47f6-a73f-735acfaf1863 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:16.614249 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:16.623993 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b664-f876-47f6-a73f-735acfaf1863 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:16.658758 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a47a8-2db1-4a49-8325-57f1d1904e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:16.659367 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a47a8-2db1-4a49-8325-57f1d1904e7d None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:16.659650 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a47a8-2db1-4a49-8325-57f1d1904e7d None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:16.659922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a47a8-2db1-4a49-8325-57f1d1904e7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:16.660571 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a47a8-2db1-4a49-8325-57f1d1904e7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:16.661976 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a47a8-2db1-4a49-8325-57f1d1904e7d None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:16.780588 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 395/790] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:39:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:39:17.494877 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e32fe-242f-41d4-8089-103a432983aa None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:17.495410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e32fe-242f-41d4-8089-103a432983aa None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:17.495410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e32fe-242f-41d4-8089-103a432983aa None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:17.496736 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 396/791] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:17.502052 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec55507-8386-48fd-ad01-e41d48b332b6 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:17.502472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec55507-8386-48fd-ad01-e41d48b332b6 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:17.502602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec55507-8386-48fd-ad01-e41d48b332b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:17.521260 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-6ec55507-8386-48fd-ad01-e41d48b332b6 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:17.522429 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-6ec55507-8386-48fd-ad01-e41d48b332b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:17.595269 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 396/792] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:17.918072 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e32fe-242f-41d4-8089-103a432983aa None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:17.995252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:18.019200 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e32fe-242f-41d4-8089-103a432983aa None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:18.053435 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa19c88-33f2-48e3-897d-8322fcac0170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:18.054056 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19c88-33f2-48e3-897d-8322fcac0170 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:18.054341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19c88-33f2-48e3-897d-8322fcac0170 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:18.054605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19c88-33f2-48e3-897d-8322fcac0170 None admin] PATH_INFO: `/v3/services/compute` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:18.055178 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa19c88-33f2-48e3-897d-8322fcac0170 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:18.056531 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa19c88-33f2-48e3-897d-8322fcac0170 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-0fa19c88-33f2-48e3-897d-8322fcac0170 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:18.065268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:18.066364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:18.067797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 397/793] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:39:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:18.073140 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec55507-8386-48fd-ad01-e41d48b332b6 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:18.140604 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:18.168550 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec55507-8386-48fd-ad01-e41d48b332b6 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:18.203132 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07debf68-fc81-4bb5-8c4a-caec6b1fc08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:18.203724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07debf68-fc81-4bb5-8c4a-caec6b1fc08f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:18.203998 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07debf68-fc81-4bb5-8c4a-caec6b1fc08f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:18.204264 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07debf68-fc81-4bb5-8c4a-caec6b1fc08f None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:18.204874 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07debf68-fc81-4bb5-8c4a-caec6b1fc08f None admin] RBAC: Adding query filter params (name=compute) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:18.205187 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07debf68-fc81-4bb5-8c4a-caec6b1fc08f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:18.206549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07debf68-fc81-4bb5-8c4a-caec6b1fc08f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:18.211088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 397/794] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:39:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:18.216896 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa19c88-33f2-48e3-897d-8322fcac0170 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:18.313382 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa19c88-33f2-48e3-897d-8322fcac0170 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:18.345820 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2523d-5d90-443a-a666-4470604db8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:18.346339 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2523d-5d90-443a-a666-4470604db8e6 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:18.346613 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2523d-5d90-443a-a666-4470604db8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:18.346878 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2523d-5d90-443a-a666-4470604db8e6 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:18.347485 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2523d-5d90-443a-a666-4470604db8e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:18.347782 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2523d-5d90-443a-a666-4470604db8e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:18.349128 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2523d-5d90-443a-a666-4470604db8e6 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:18.353493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 398/795] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:39:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:39:19.223552 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb738-043f-42b8-8940-dff1321ff47a None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:19.224083 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb738-043f-42b8-8940-dff1321ff47a None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:19.224083 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb738-043f-42b8-8940-dff1321ff47a None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:19.225437 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 398/796] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:19.231098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f30244-2579-4a40-9e84-cc67cf104e5a None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:19.231495 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f30244-2579-4a40-9e84-cc67cf104e5a None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:19.231646 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f30244-2579-4a40-9e84-cc67cf104e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:19.238894 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:19.250370 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-96f30244-2579-4a40-9e84-cc67cf104e5a None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:19.251548 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-96f30244-2579-4a40-9e84-cc67cf104e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:19.316595 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 399/797] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:19 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:19.643700 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb738-043f-42b8-8940-dff1321ff47a None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:19.744786 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb738-043f-42b8-8940-dff1321ff47a None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:19.777893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:19.778488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:19.778761 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:19.779025 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:19.779649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:19.781065 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:19.783683 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WARNING keystone.server.flask.common [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 17 20:39:19.787620 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:19.865041 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.sql.core [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 20:39:19.865041 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 20:39:19.865041 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [parameters: {'id': '6c14271962974965bdbc1d0446b3b462', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 20:39:19.865041 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=100115) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6c14271962974965bdbc1d0446b3b462.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6c14271962974965bdbc1d0446b3b462. Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application conn.query(q) Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:39:19.883354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application result.read() Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 17 20:39:19.884197 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application next(self.gen) Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application yield resource Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application next(self.gen) Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise self.value Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application session.commit() Sep 17 20:39:19.885328 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.session.flush() Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application compat.raise_( Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 20:39:19.886836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 20:39:19.888128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application conn.query(q) Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application result.read() Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:39:19.889347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [parameters: {'id': '6c14271962974965bdbc1d0446b3b462', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:19.890669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:19.891690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6c14271962974965bdbc1d0446b3b462. Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:19.892885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 399/798] 10.222.0.52 () {60 vars in 1140 bytes} [Sat Sep 17 20:39:19 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:19.893559 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f30244-2579-4a40-9e84-cc67cf104e5a None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:19.990569 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f30244-2579-4a40-9e84-cc67cf104e5a None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:20.023439 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0a217-75d5-4e31-a1de-04dea1c326d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:20.024044 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0a217-75d5-4e31-a1de-04dea1c326d2 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:20.024316 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0a217-75d5-4e31-a1de-04dea1c326d2 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:20.024582 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0a217-75d5-4e31-a1de-04dea1c326d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:20.026424 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:20.031501 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0a217-75d5-4e31-a1de-04dea1c326d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:20.032920 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0a217-75d5-4e31-a1de-04dea1c326d2 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-a7c0a217-75d5-4e31-a1de-04dea1c326d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:39:20.044347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:20.045352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:20.046268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:39:20.046268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:39:20.046268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:39:20.046268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:39:20.046268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:39:20.046268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:39:20.046268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:39:20.046268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:20.046268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 400/799] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:20.051546 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:20.151004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77d1d4-5be4-48c7-a826-6b847110cb30 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:20.184468 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2712caf-9299-4cca-912f-0b8bec16bcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:20.185070 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2712caf-9299-4cca-912f-0b8bec16bcc5 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:20.185385 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2712caf-9299-4cca-912f-0b8bec16bcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:20.185653 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2712caf-9299-4cca-912f-0b8bec16bcc5 None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:20.186299 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2712caf-9299-4cca-912f-0b8bec16bcc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:20.186597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2712caf-9299-4cca-912f-0b8bec16bcc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:20.188224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2712caf-9299-4cca-912f-0b8bec16bcc5 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:20.207391 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 400/800] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:39:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:20.793146 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9288b14-5744-4073-afab-2357bb3038b1 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:20.793699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9288b14-5744-4073-afab-2357bb3038b1 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:20.793699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9288b14-5744-4073-afab-2357bb3038b1 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:20.795031 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 401/801] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:20.800443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d7c05-bd0a-4fa0-8dcf-f1f63b56683a None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:20.800859 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d7c05-bd0a-4fa0-8dcf-f1f63b56683a None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:20.800984 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d7c05-bd0a-4fa0-8dcf-f1f63b56683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:20.823064 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-712d7c05-bd0a-4fa0-8dcf-f1f63b56683a None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:20.824546 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-712d7c05-bd0a-4fa0-8dcf-f1f63b56683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:20.870137 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:20.888358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 401/802] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:20 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:21.214325 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9288b14-5744-4073-afab-2357bb3038b1 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:21.323379 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9288b14-5744-4073-afab-2357bb3038b1 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:21.359110 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc3c8d-3fe5-44fa-b4c7-7527f9ff8a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:21.359777 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc3c8d-3fe5-44fa-b4c7-7527f9ff8a69 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:21.360127 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc3c8d-3fe5-44fa-b4c7-7527f9ff8a69 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:21.360360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc3c8d-3fe5-44fa-b4c7-7527f9ff8a69 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:21.361015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc3c8d-3fe5-44fa-b4c7-7527f9ff8a69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:21.362387 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc3c8d-3fe5-44fa-b4c7-7527f9ff8a69 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:21.459854 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 402/803] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:39:21 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:39:22.696609 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b2435-45ef-4300-a130-0c593ec5d2ba None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:22.697194 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b2435-45ef-4300-a130-0c593ec5d2ba None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:22.697194 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b2435-45ef-4300-a130-0c593ec5d2ba None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:22.698518 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 402/804] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:22.703865 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c89ea-5cd8-44ab-9c41-d7de20cc8992 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:22.704266 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c89ea-5cd8-44ab-9c41-d7de20cc8992 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:22.704421 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c89ea-5cd8-44ab-9c41-d7de20cc8992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:22.723496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-7b1c89ea-5cd8-44ab-9c41-d7de20cc8992 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:22.724685 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-7b1c89ea-5cd8-44ab-9c41-d7de20cc8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:22.773742 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:22.796475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 403/805] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:22 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:23.119668 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b2435-45ef-4300-a130-0c593ec5d2ba None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:23.229549 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b2435-45ef-4300-a130-0c593ec5d2ba None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:23.262924 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:23.263516 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:23.263829 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:23.264095 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:23.264727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:23.266240 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:23.322515 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.sql.core [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 20:39:23.322515 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 20:39:23.322515 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [parameters: {'user_id': '3a95c6812b6a4852a614937b14b9e3e7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 20:39:23.322515 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=100115) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application conn.query(q) Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application result.read() Sep 17 20:39:23.329543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 20:39:23.330503 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application next(self.gen) Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application yield resource Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application next(self.gen) Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise self.value Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application session.commit() Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 20:39:23.331448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.session.flush() Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application compat.raise_( Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 20:39:23.332387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:39:23.333322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application conn.query(q) Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application result.read() Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:39:23.334280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [parameters: {'user_id': '3a95c6812b6a4852a614937b14b9e3e7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:23.335080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 17 20:39:23.336540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 17 20:39:23.337491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 17 20:39:23.337491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 17 20:39:23.337491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 20:39:23.337491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 20:39:23.337491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 20:39:23.337491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:23.337491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 403/806] 10.222.0.52 () {60 vars in 1131 bytes} [Sat Sep 17 20:39:23 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:23.339280 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c89ea-5cd8-44ab-9c41-d7de20cc8992 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:23.439886 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c89ea-5cd8-44ab-9c41-d7de20cc8992 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:23.478157 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb119e6-8bf8-406c-8eae-c4a8ba9b0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:23.478779 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb119e6-8bf8-406c-8eae-c4a8ba9b0c9b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:23.479051 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb119e6-8bf8-406c-8eae-c4a8ba9b0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:23.479314 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb119e6-8bf8-406c-8eae-c4a8ba9b0c9b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:23.486698 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb119e6-8bf8-406c-8eae-c4a8ba9b0c9b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:23.488120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb119e6-8bf8-406c-8eae-c4a8ba9b0c9b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-4fb119e6-8bf8-406c-8eae-c4a8ba9b0c9b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:39:23.500763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:23.501842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:23.502770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 404/807] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:39:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:23.508829 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:23.554061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:23.607907 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45cc7d-5321-4359-865d-971f7b01e18a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:23.641544 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efdb38-45d0-4436-b68b-e3dfdda88fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:23.642151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdb38-45d0-4436-b68b-e3dfdda88fde None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:23.642429 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdb38-45d0-4436-b68b-e3dfdda88fde None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:23.642699 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdb38-45d0-4436-b68b-e3dfdda88fde None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:23.643385 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efdb38-45d0-4436-b68b-e3dfdda88fde None admin] RBAC: Adding query filter params (name=cinder) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:23.643686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efdb38-45d0-4436-b68b-e3dfdda88fde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:23.645338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efdb38-45d0-4436-b68b-e3dfdda88fde None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:23.682295 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 404/808] 10.222.0.52 () {56 vars in 1101 bytes} [Sat Sep 17 20:39:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:23.899614 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7994b9-e257-4267-b608-0a1ea1195a1b None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:23.900166 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7994b9-e257-4267-b608-0a1ea1195a1b None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:23.900166 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7994b9-e257-4267-b608-0a1ea1195a1b None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:23.901551 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 405/809] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:23.907200 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73124e8-86f7-4c86-b500-44e4bd6e78ff None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:23.907667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73124e8-86f7-4c86-b500-44e4bd6e78ff None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:23.907771 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73124e8-86f7-4c86-b500-44e4bd6e78ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:23.926932 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-a73124e8-86f7-4c86-b500-44e4bd6e78ff None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:23.928441 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-a73124e8-86f7-4c86-b500-44e4bd6e78ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:24.016103 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 405/810] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:23 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:24.351142 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7994b9-e257-4267-b608-0a1ea1195a1b None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:24.395448 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:24.452941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7994b9-e257-4267-b608-0a1ea1195a1b None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:24.486305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b91d4-a76e-4e96-8c59-29a14d141707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:24.486963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b91d4-a76e-4e96-8c59-29a14d141707 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:24.487240 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b91d4-a76e-4e96-8c59-29a14d141707 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:24.487514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b91d4-a76e-4e96-8c59-29a14d141707 None admin] PATH_INFO: `/v3/services/compute` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:24.488088 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b91d4-a76e-4e96-8c59-29a14d141707 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:24.489477 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b91d4-a76e-4e96-8c59-29a14d141707 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-c18b91d4-a76e-4e96-8c59-29a14d141707 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:24.498348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:24.499491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:39:24.500347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 406/811] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:39:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:24.505631 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73124e8-86f7-4c86-b500-44e4bd6e78ff None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:24.536210 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:24.602385 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73124e8-86f7-4c86-b500-44e4bd6e78ff None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:24.634272 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00108c13-ce37-46f9-a62f-35b9a74cfe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:24.634855 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00108c13-ce37-46f9-a62f-35b9a74cfe97 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:24.635126 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00108c13-ce37-46f9-a62f-35b9a74cfe97 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:24.635389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00108c13-ce37-46f9-a62f-35b9a74cfe97 None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:24.635995 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00108c13-ce37-46f9-a62f-35b9a74cfe97 None admin] RBAC: Adding query filter params (name=compute) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:24.636290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00108c13-ce37-46f9-a62f-35b9a74cfe97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:24.637673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00108c13-ce37-46f9-a62f-35b9a74cfe97 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:24.642239 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 406/812] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:39:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:24.649388 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b91d4-a76e-4e96-8c59-29a14d141707 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:24.746569 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b91d4-a76e-4e96-8c59-29a14d141707 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:24.748796 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:24.779473 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c2c57-b495-4ff7-9cdf-560b50964425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:24.780060 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2c57-b495-4ff7-9cdf-560b50964425 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:24.780342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2c57-b495-4ff7-9cdf-560b50964425 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:24.780612 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2c57-b495-4ff7-9cdf-560b50964425 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:24.781254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c2c57-b495-4ff7-9cdf-560b50964425 None admin] RBAC: Adding query filter params (type=compute) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:24.781555 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c2c57-b495-4ff7-9cdf-560b50964425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:24.782959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c2c57-b495-4ff7-9cdf-560b50964425 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:24.787655 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 407/813] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:39:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:24.794044 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00108c13-ce37-46f9-a62f-35b9a74cfe97 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:24.883786 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:24.889205 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00108c13-ce37-46f9-a62f-35b9a74cfe97 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:24.923233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef9674-62b4-4836-a646-67678420b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:24.923826 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef9674-62b4-4836-a646-67678420b798 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:24.924076 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef9674-62b4-4836-a646-67678420b798 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:24.924339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef9674-62b4-4836-a646-67678420b798 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:24.925013 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef9674-62b4-4836-a646-67678420b798 None admin] RBAC: Adding query filter params (interface=public, service_id=26f7eec529fb4b5da370b061f733a7ca, region_id=RegionOne) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:24.925360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef9674-62b4-4836-a646-67678420b798 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:24.926693 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef9674-62b4-4836-a646-67678420b798 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:24.932276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 407/814] 10.222.0.52 () {56 vars in 1251 bytes} [Sat Sep 17 20:39:24 2022] GET /identity/v3/endpoints?service_id=26f7eec529fb4b5da370b061f733a7ca&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:24.938054 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c2c57-b495-4ff7-9cdf-560b50964425 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:25.037674 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c2c57-b495-4ff7-9cdf-560b50964425 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:25.072152 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c4fe0-b4cf-4a2f-9a29-854fdf95cc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:25.072738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4fe0-b4cf-4a2f-9a29-854fdf95cc56 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:25.073021 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4fe0-b4cf-4a2f-9a29-854fdf95cc56 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:25.073322 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4fe0-b4cf-4a2f-9a29-854fdf95cc56 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:25.073917 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c4fe0-b4cf-4a2f-9a29-854fdf95cc56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:25.075276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c4fe0-b4cf-4a2f-9a29-854fdf95cc56 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:25.081225 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 408/815] 10.222.0.52 () {56 vars in 1087 bytes} [Sat Sep 17 20:39:24 2022] GET /identity/v3/services => generated 1728 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:39:27.569060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a1ce-dbe9-4fb2-9302-aa01a35754d6 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:27.570404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a1ce-dbe9-4fb2-9302-aa01a35754d6 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:27.570562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a1ce-dbe9-4fb2-9302-aa01a35754d6 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:27.572330 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 408/816] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:39:27.577541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d31e7-4a6b-4396-b167-07a0c3fd8644 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:27.577969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d31e7-4a6b-4396-b167-07a0c3fd8644 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:27.578062 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d31e7-4a6b-4396-b167-07a0c3fd8644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:27.596887 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-c01d31e7-4a6b-4396-b167-07a0c3fd8644 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:39:27.598085 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-c01d31e7-4a6b-4396-b167-07a0c3fd8644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:39:27.622593 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:27.661758 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 409/817] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:39:27 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:39:27.983970 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a1ce-dbe9-4fb2-9302-aa01a35754d6 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:28.088257 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a1ce-dbe9-4fb2-9302-aa01a35754d6 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:28.121268 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f901c-11cf-48d2-8b16-ffa6ebfe173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:28.121885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f901c-11cf-48d2-8b16-ffa6ebfe173f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:28.122160 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f901c-11cf-48d2-8b16-ffa6ebfe173f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:28.122425 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f901c-11cf-48d2-8b16-ffa6ebfe173f None admin] PATH_INFO: `/v3/services/compute` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:28.122996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f901c-11cf-48d2-8b16-ffa6ebfe173f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:28.124350 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f901c-11cf-48d2-8b16-ffa6ebfe173f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-ac9f901c-11cf-48d2-8b16-ffa6ebfe173f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:39:28.133851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:39:28.135015 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:39:28.136151 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 409/818] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:39:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:39:28.141460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d31e7-4a6b-4396-b167-07a0c3fd8644 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:28.236527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d31e7-4a6b-4396-b167-07a0c3fd8644 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:28.268642 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84113473-0b58-44fb-bfb2-e4f3d936a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:28.269255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84113473-0b58-44fb-bfb2-e4f3d936a00b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:28.269532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84113473-0b58-44fb-bfb2-e4f3d936a00b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:28.269800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84113473-0b58-44fb-bfb2-e4f3d936a00b None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:28.270417 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84113473-0b58-44fb-bfb2-e4f3d936a00b None admin] RBAC: Adding query filter params (name=compute) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:28.270713 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84113473-0b58-44fb-bfb2-e4f3d936a00b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:28.272063 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84113473-0b58-44fb-bfb2-e4f3d936a00b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:28.276627 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 410/819] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:39:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:28.282210 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f901c-11cf-48d2-8b16-ffa6ebfe173f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:28.307845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:28.385779 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f901c-11cf-48d2-8b16-ffa6ebfe173f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:28.419030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67011c71-65c6-41ab-be3f-a1ff8dc16dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:28.419625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011c71-65c6-41ab-be3f-a1ff8dc16dbd None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:28.419901 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011c71-65c6-41ab-be3f-a1ff8dc16dbd None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:28.420171 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011c71-65c6-41ab-be3f-a1ff8dc16dbd None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:28.420792 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67011c71-65c6-41ab-be3f-a1ff8dc16dbd None admin] RBAC: Adding query filter params (type=compute) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:39:28.421091 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67011c71-65c6-41ab-be3f-a1ff8dc16dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:28.422513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67011c71-65c6-41ab-be3f-a1ff8dc16dbd None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:28.427107 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 410/820] 10.222.0.52 () {56 vars in 1112 bytes} [Sat Sep 17 20:39:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:39:28.433462 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84113473-0b58-44fb-bfb2-e4f3d936a00b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:39:28.460507 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:28.531165 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84113473-0b58-44fb-bfb2-e4f3d936a00b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:39:28.564359 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809da2d-9d17-49b5-b80c-4e4d193f21a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:39:28.564945 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809da2d-9d17-49b5-b80c-4e4d193f21a6 None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:39:28.565251 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809da2d-9d17-49b5-b80c-4e4d193f21a6 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:39:28.565526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809da2d-9d17-49b5-b80c-4e4d193f21a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:39:28.566191 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809da2d-9d17-49b5-b80c-4e4d193f21a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:39:28.567554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809da2d-9d17-49b5-b80c-4e4d193f21a6 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:39:28.641575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 411/821] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:39:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:39:38.424701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=56 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:39:38.637412 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=58,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:48.416703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca91258-2025-45aa-88fb-d1c42a8420c6 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:48.417317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca91258-2025-45aa-88fb-d1c42a8420c6 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:48.417317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca91258-2025-45aa-88fb-d1c42a8420c6 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:48.418609 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 411/822] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:40:48.424051 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04cfe-99c5-42ed-9144-f1d8527d58bb None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:48.424452 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04cfe-99c5-42ed-9144-f1d8527d58bb None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:48.424659 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04cfe-99c5-42ed-9144-f1d8527d58bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:48.442866 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-73d04cfe-99c5-42ed-9144-f1d8527d58bb None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:40:48.444147 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-73d04cfe-99c5-42ed-9144-f1d8527d58bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:40:48.517029 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 412/823] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:40:48 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:40:48.844064 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca91258-2025-45aa-88fb-d1c42a8420c6 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:48.944577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca91258-2025-45aa-88fb-d1c42a8420c6 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:48.978547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0951eb-c180-4a93-ba1f-e185525027d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:48.979158 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0951eb-c180-4a93-ba1f-e185525027d8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:48.979494 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0951eb-c180-4a93-ba1f-e185525027d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:48.979802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0951eb-c180-4a93-ba1f-e185525027d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:48.989463 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0951eb-c180-4a93-ba1f-e185525027d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:48.990893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0951eb-c180-4a93-ba1f-e185525027d8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-6c0951eb-c180-4a93-ba1f-e185525027d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:40:49.005707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:49.006884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:40:49.008059 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:40:49.008059 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:49.008059 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:40:49.008059 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 412/824] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:49.013317 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d04cfe-99c5-42ed-9144-f1d8527d58bb None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:49.110109 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d04cfe-99c5-42ed-9144-f1d8527d58bb None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:49.135163 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:49.143676 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf61299-aec6-4482-acae-dd40b944aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:49.144269 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf61299-aec6-4482-acae-dd40b944aac7 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:49.144540 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf61299-aec6-4482-acae-dd40b944aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:49.144803 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf61299-aec6-4482-acae-dd40b944aac7 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:49.145456 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf61299-aec6-4482-acae-dd40b944aac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:49.145855 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf61299-aec6-4482-acae-dd40b944aac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:49.147213 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf61299-aec6-4482-acae-dd40b944aac7 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:49.158300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 413/825] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:49.164129 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0951eb-c180-4a93-ba1f-e185525027d8 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:49.216927 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:49.263009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0951eb-c180-4a93-ba1f-e185525027d8 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:49.295371 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b8c22-34be-4579-a21a-ce32e179d6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:49.296508 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b8c22-34be-4579-a21a-ce32e179d6dc None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:49.296916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b8c22-34be-4579-a21a-ce32e179d6dc None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:49.297204 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b8c22-34be-4579-a21a-ce32e179d6dc None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:49.297831 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b8c22-34be-4579-a21a-ce32e179d6dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:49.299249 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b8c22-34be-4579-a21a-ce32e179d6dc None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:49.386551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 413/826] 10.222.0.52 () {60 vars in 1132 bytes} [Sat Sep 17 20:40:49 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:40:51.820019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12115c4-9309-440b-bbb2-f0db65a04c2a None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:51.820562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12115c4-9309-440b-bbb2-f0db65a04c2a None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:51.820662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12115c4-9309-440b-bbb2-f0db65a04c2a None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:51.821964 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 414/827] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:40:51.827783 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c283d-8666-4aad-9e77-f6b921841b97 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:51.828271 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c283d-8666-4aad-9e77-f6b921841b97 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:51.828701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c283d-8666-4aad-9e77-f6b921841b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:51.847226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-e20c283d-8666-4aad-9e77-f6b921841b97 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:40:51.848401 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-e20c283d-8666-4aad-9e77-f6b921841b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:40:51.916315 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 414/828] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:40:51 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:40:52.256584 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12115c4-9309-440b-bbb2-f0db65a04c2a None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:52.363293 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12115c4-9309-440b-bbb2-f0db65a04c2a None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:52.400832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3efc34-19a2-474c-a9e1-487c0cb792da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:52.401477 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3efc34-19a2-474c-a9e1-487c0cb792da None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:52.401750 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3efc34-19a2-474c-a9e1-487c0cb792da None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:52.402015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3efc34-19a2-474c-a9e1-487c0cb792da None admin] PATH_INFO: `/v3/roles/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:52.413137 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3efc34-19a2-474c-a9e1-487c0cb792da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-fb3efc34-19a2-474c-a9e1-487c0cb792da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:40:52.417985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:52.419120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:40:52.420391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 415/829] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:40:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:52.426336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c283d-8666-4aad-9e77-f6b921841b97 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:52.465444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:52.523178 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c283d-8666-4aad-9e77-f6b921841b97 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:52.556943 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b1b4-6a51-4772-a453-4a1f5eb48306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:52.557622 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b1b4-6a51-4772-a453-4a1f5eb48306 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:52.557902 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b1b4-6a51-4772-a453-4a1f5eb48306 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:52.558175 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b1b4-6a51-4772-a453-4a1f5eb48306 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:52.558831 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b1b4-6a51-4772-a453-4a1f5eb48306 None admin] RBAC: Adding query filter params (name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:52.559135 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b1b4-6a51-4772-a453-4a1f5eb48306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:52.560499 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b1b4-6a51-4772-a453-4a1f5eb48306 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:52.568149 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 415/830] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:40:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:52.574335 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3efc34-19a2-474c-a9e1-487c0cb792da None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:52.622066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:52.673616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3efc34-19a2-474c-a9e1-487c0cb792da None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:52.706548 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070418-bceb-4680-a4f3-132bc8bed1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:52.707181 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070418-bceb-4680-a4f3-132bc8bed1cd None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:52.707453 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070418-bceb-4680-a4f3-132bc8bed1cd None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:52.707718 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070418-bceb-4680-a4f3-132bc8bed1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:52.718599 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94070418-bceb-4680-a4f3-132bc8bed1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:52.720161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94070418-bceb-4680-a4f3-132bc8bed1cd None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-94070418-bceb-4680-a4f3-132bc8bed1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:40:52.734731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:52.735840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:40:52.736720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:40:52.736720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:52.736720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:40:52.736720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 416/831] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:52.741794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b1b4-6a51-4772-a453-4a1f5eb48306 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:52.838501 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:52.841494 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b1b4-6a51-4772-a453-4a1f5eb48306 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:52.876201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d72be-1e6c-4189-b3cb-877977c0ab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:52.876803 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d72be-1e6c-4189-b3cb-877977c0ab8f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:52.877083 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d72be-1e6c-4189-b3cb-877977c0ab8f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:52.877387 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d72be-1e6c-4189-b3cb-877977c0ab8f None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:52.878024 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d72be-1e6c-4189-b3cb-877977c0ab8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:52.878323 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d72be-1e6c-4189-b3cb-877977c0ab8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:52.879686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d72be-1e6c-4189-b3cb-877977c0ab8f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:52.891385 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 416/832] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:52.897149 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070418-bceb-4680-a4f3-132bc8bed1cd None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:52.992191 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:52.995935 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070418-bceb-4680-a4f3-132bc8bed1cd None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:53.032156 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b728d-8a25-491d-8c64-ab81b1a5ec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:53.032791 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b728d-8a25-491d-8c64-ab81b1a5ec47 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:53.033073 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b728d-8a25-491d-8c64-ab81b1a5ec47 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:53.033374 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b728d-8a25-491d-8c64-ab81b1a5ec47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:53.041090 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b728d-8a25-491d-8c64-ab81b1a5ec47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:53.042555 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b728d-8a25-491d-8c64-ab81b1a5ec47 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-515b728d-8a25-491d-8c64-ab81b1a5ec47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:40:53.054024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:53.059169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:40:53.060245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 417/833] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:40:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:53.061050 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d72be-1e6c-4189-b3cb-877977c0ab8f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:53.158646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d72be-1e6c-4189-b3cb-877977c0ab8f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:53.191207 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eab527-d27f-4bda-b3d0-9437deb75d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:53.191807 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eab527-d27f-4bda-b3d0-9437deb75d86 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:53.192081 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eab527-d27f-4bda-b3d0-9437deb75d86 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:53.192347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eab527-d27f-4bda-b3d0-9437deb75d86 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:53.193056 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eab527-d27f-4bda-b3d0-9437deb75d86 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:53.193396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eab527-d27f-4bda-b3d0-9437deb75d86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:53.194839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eab527-d27f-4bda-b3d0-9437deb75d86 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:53.212102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 417/834] 10.222.0.52 () {56 vars in 1143 bytes} [Sat Sep 17 20:40:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:53.218142 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b728d-8a25-491d-8c64-ab81b1a5ec47 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:53.315430 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b728d-8a25-491d-8c64-ab81b1a5ec47 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:53.351539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862af28-173f-471b-a965-454059e71f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:53.352137 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862af28-173f-471b-a965-454059e71f8e None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:53.352415 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862af28-173f-471b-a965-454059e71f8e None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:53.352684 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862af28-173f-471b-a965-454059e71f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:53.379152 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:53.420027 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862af28-173f-471b-a965-454059e71f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:53.421804 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862af28-173f-471b-a965-454059e71f8e None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:53.523511 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 418/835] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:40:53 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 20:40:53.529599 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eab527-d27f-4bda-b3d0-9437deb75d86 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:53.549887 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:53.635499 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eab527-d27f-4bda-b3d0-9437deb75d86 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:53.670988 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87bbff-b02f-4a13-90b3-9acbb885bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:53.671882 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87bbff-b02f-4a13-90b3-9acbb885bda8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:53.672153 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87bbff-b02f-4a13-90b3-9acbb885bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:53.672418 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87bbff-b02f-4a13-90b3-9acbb885bda8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:53.683469 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87bbff-b02f-4a13-90b3-9acbb885bda8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:53.685251 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87bbff-b02f-4a13-90b3-9acbb885bda8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-aa87bbff-b02f-4a13-90b3-9acbb885bda8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:40:53.704642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:53.705920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:40:53.706929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:40:53.706929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:53.706929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:40:53.706929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 418/836] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:53.711597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862af28-173f-471b-a965-454059e71f8e None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:53.769347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:53.810014 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862af28-173f-471b-a965-454059e71f8e None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:53.844355 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81844a-a4ad-4e64-b0fc-0926bed16de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:53.844953 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81844a-a4ad-4e64-b0fc-0926bed16de7 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:53.845266 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81844a-a4ad-4e64-b0fc-0926bed16de7 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:53.845539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81844a-a4ad-4e64-b0fc-0926bed16de7 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:53.846171 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81844a-a4ad-4e64-b0fc-0926bed16de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:53.846467 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81844a-a4ad-4e64-b0fc-0926bed16de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:53.847812 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81844a-a4ad-4e64-b0fc-0926bed16de7 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:53.859495 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 419/837] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:53.865310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87bbff-b02f-4a13-90b3-9acbb885bda8 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:53.936391 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:53.966139 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87bbff-b02f-4a13-90b3-9acbb885bda8 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:53.998649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42238b-cd74-4c8b-8666-2491f3b2590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:53.999295 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42238b-cd74-4c8b-8666-2491f3b2590f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:53.999569 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42238b-cd74-4c8b-8666-2491f3b2590f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:53.999933 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42238b-cd74-4c8b-8666-2491f3b2590f None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:54.006301 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42238b-cd74-4c8b-8666-2491f3b2590f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:54.007726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42238b-cd74-4c8b-8666-2491f3b2590f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-9c42238b-cd74-4c8b-8666-2491f3b2590f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:40:54.018687 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:54.019738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:54.020718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:40:54.020718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:40:54.020718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:40:54.020718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:40:54.020718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:40:54.020718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:40:54.020718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:40:54.020718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:40:54.020718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 419/838] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:54.026129 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81844a-a4ad-4e64-b0fc-0926bed16de7 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:54.126886 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81844a-a4ad-4e64-b0fc-0926bed16de7 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:54.143801 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:54.159971 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748365-fe4f-446a-86d8-83b776cc592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:54.160567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748365-fe4f-446a-86d8-83b776cc592b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:54.160848 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748365-fe4f-446a-86d8-83b776cc592b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:54.161122 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748365-fe4f-446a-86d8-83b776cc592b None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:54.161836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748365-fe4f-446a-86d8-83b776cc592b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:54.162141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748365-fe4f-446a-86d8-83b776cc592b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:54.163565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748365-fe4f-446a-86d8-83b776cc592b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:54.175227 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 420/839] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:40:54.181478 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42238b-cd74-4c8b-8666-2491f3b2590f None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:54.278866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42238b-cd74-4c8b-8666-2491f3b2590f None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:54.306669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:54.313445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad4bcf-1792-4141-9836-9258eb03f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:54.314043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad4bcf-1792-4141-9836-9258eb03f115 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:54.314322 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad4bcf-1792-4141-9836-9258eb03f115 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:54.314592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad4bcf-1792-4141-9836-9258eb03f115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:54.315299 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad4bcf-1792-4141-9836-9258eb03f115 None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=88caaed0c8c4438ea57d2f313fcf287a) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:54.315632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad4bcf-1792-4141-9836-9258eb03f115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:54.317125 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad4bcf-1792-4141-9836-9258eb03f115 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:54.322385 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 420/840] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:40:54 2022] GET /identity/v3/role_assignments?user.id=88caaed0c8c4438ea57d2f313fcf287a&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:56.704259 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b16e-ffe2-4bcb-bc40-8f166eb7c205 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:56.704853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b16e-ffe2-4bcb-bc40-8f166eb7c205 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:56.704853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b16e-ffe2-4bcb-bc40-8f166eb7c205 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:56.706141 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 421/841] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:40:56.711217 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c99c81-28e8-4dac-a5bd-307bae936a51 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:56.711637 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c99c81-28e8-4dac-a5bd-307bae936a51 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:56.711822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c99c81-28e8-4dac-a5bd-307bae936a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:56.730420 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-00c99c81-28e8-4dac-a5bd-307bae936a51 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:40:56.731607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-00c99c81-28e8-4dac-a5bd-307bae936a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:40:56.799458 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 421/842] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:40:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:40:57.120211 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b16e-ffe2-4bcb-bc40-8f166eb7c205 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:57.223900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b16e-ffe2-4bcb-bc40-8f166eb7c205 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:57.256507 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e5560-f062-417d-8435-30d1885dbdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:57.257114 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e5560-f062-417d-8435-30d1885dbdc7 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:57.257420 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e5560-f062-417d-8435-30d1885dbdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:57.257687 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e5560-f062-417d-8435-30d1885dbdc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:57.268038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e5560-f062-417d-8435-30d1885dbdc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-e15e5560-f062-417d-8435-30d1885dbdc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:40:57.272752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:57.277901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:40:57.278952 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 422/843] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:57.279825 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c99c81-28e8-4dac-a5bd-307bae936a51 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:57.374708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c99c81-28e8-4dac-a5bd-307bae936a51 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:57.397157 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:57.407467 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a29076-b28a-417c-939c-fdc0bb70789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:57.408061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a29076-b28a-417c-939c-fdc0bb70789e None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:57.408336 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a29076-b28a-417c-939c-fdc0bb70789e None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:57.408654 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a29076-b28a-417c-939c-fdc0bb70789e None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:57.409327 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a29076-b28a-417c-939c-fdc0bb70789e None admin] RBAC: Adding query filter params (name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:57.409625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a29076-b28a-417c-939c-fdc0bb70789e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:57.410979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a29076-b28a-417c-939c-fdc0bb70789e None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:57.418575 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 422/844] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:40:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:57.425065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e5560-f062-417d-8435-30d1885dbdc7 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:57.465180 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:57.524531 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e5560-f062-417d-8435-30d1885dbdc7 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:57.558389 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdadb4f-5202-48c3-ad47-8e2ed64452da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:57.559046 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdadb4f-5202-48c3-ad47-8e2ed64452da None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:57.559324 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdadb4f-5202-48c3-ad47-8e2ed64452da None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:57.559592 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdadb4f-5202-48c3-ad47-8e2ed64452da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:57.570065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdadb4f-5202-48c3-ad47-8e2ed64452da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:57.571484 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdadb4f-5202-48c3-ad47-8e2ed64452da None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-7bdadb4f-5202-48c3-ad47-8e2ed64452da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:40:57.586074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:57.591678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:40:57.592710 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:40:57.592710 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:57.592710 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:40:57.592710 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 423/845] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:57.593121 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a29076-b28a-417c-939c-fdc0bb70789e None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:57.698252 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a29076-b28a-417c-939c-fdc0bb70789e None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:57.731539 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b0c25-6596-4818-8441-12bb96eee94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:57.732141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b0c25-6596-4818-8441-12bb96eee94a None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:57.732405 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b0c25-6596-4818-8441-12bb96eee94a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:57.732677 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b0c25-6596-4818-8441-12bb96eee94a None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:57.733338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b0c25-6596-4818-8441-12bb96eee94a None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:57.734263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b0c25-6596-4818-8441-12bb96eee94a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:57.735646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b0c25-6596-4818-8441-12bb96eee94a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:57.746834 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 423/846] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:57.752712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdadb4f-5202-48c3-ad47-8e2ed64452da None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:57.844147 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:57.853394 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdadb4f-5202-48c3-ad47-8e2ed64452da None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:57.885632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edc97b-973a-4da0-a6b7-1939e7afe123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:57.886256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edc97b-973a-4da0-a6b7-1939e7afe123 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:57.886530 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edc97b-973a-4da0-a6b7-1939e7afe123 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:57.886800 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edc97b-973a-4da0-a6b7-1939e7afe123 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:57.894888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edc97b-973a-4da0-a6b7-1939e7afe123 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:57.896309 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edc97b-973a-4da0-a6b7-1939e7afe123 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-44edc97b-973a-4da0-a6b7-1939e7afe123 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:40:57.907662 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:57.908761 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:40:57.909933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 424/847] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:40:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:57.914738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b0c25-6596-4818-8441-12bb96eee94a None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:57.961934 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:58.011994 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b0c25-6596-4818-8441-12bb96eee94a None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:58.045532 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea8df6-0ff3-42a6-84f6-011dda35b247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:58.046191 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea8df6-0ff3-42a6-84f6-011dda35b247 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:58.047404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea8df6-0ff3-42a6-84f6-011dda35b247 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:58.047674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea8df6-0ff3-42a6-84f6-011dda35b247 None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:58.048540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea8df6-0ff3-42a6-84f6-011dda35b247 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:58.048841 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea8df6-0ff3-42a6-84f6-011dda35b247 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:58.050275 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea8df6-0ff3-42a6-84f6-011dda35b247 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:58.066682 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 424/848] 10.222.0.52 () {56 vars in 1143 bytes} [Sat Sep 17 20:40:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:58.072433 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edc97b-973a-4da0-a6b7-1939e7afe123 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:58.171000 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edc97b-973a-4da0-a6b7-1939e7afe123 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:58.203562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4d86a-7557-4e4c-897d-a310f7337d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:58.204172 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d86a-7557-4e4c-897d-a310f7337d0c None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:58.204452 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d86a-7557-4e4c-897d-a310f7337d0c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:58.204721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d86a-7557-4e4c-897d-a310f7337d0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:58.214830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4d86a-7557-4e4c-897d-a310f7337d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:58.216209 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4d86a-7557-4e4c-897d-a310f7337d0c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-e6a4d86a-7557-4e4c-897d-a310f7337d0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:40:58.230633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:58.231938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:40:58.232979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:40:58.232979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:40:58.232979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:40:58.232979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 425/849] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:58.237704 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea8df6-0ff3-42a6-84f6-011dda35b247 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:58.338794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea8df6-0ff3-42a6-84f6-011dda35b247 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:58.341109 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:58.373642 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3950-3892-4620-ae8a-c56a836888c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:58.374204 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3950-3892-4620-ae8a-c56a836888c8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:58.374547 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3950-3892-4620-ae8a-c56a836888c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:58.374817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3950-3892-4620-ae8a-c56a836888c8 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:58.378903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd3950-3892-4620-ae8a-c56a836888c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:58.379233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd3950-3892-4620-ae8a-c56a836888c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:58.380678 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd3950-3892-4620-ae8a-c56a836888c8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:58.392523 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 425/850] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:40:58.398280 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4d86a-7557-4e4c-897d-a310f7337d0c None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:58.401520 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:58.497679 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4d86a-7557-4e4c-897d-a310f7337d0c None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:58.540604 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768a69-0148-4e0c-8072-00c92b17f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:58.541278 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768a69-0148-4e0c-8072-00c92b17f631 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:58.541562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768a69-0148-4e0c-8072-00c92b17f631 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:58.541835 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768a69-0148-4e0c-8072-00c92b17f631 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:58.549811 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1768a69-0148-4e0c-8072-00c92b17f631 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:58.551537 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1768a69-0148-4e0c-8072-00c92b17f631 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-a1768a69-0148-4e0c-8072-00c92b17f631 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:40:58.564601 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:40:58.565826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:40:58.567423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:40:58.567423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:40:58.567423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:40:58.567423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:40:58.567423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:40:58.567423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:40:58.567423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:40:58.567423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:40:58.569678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 426/851] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:40:58.571789 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3950-3892-4620-ae8a-c56a836888c8 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:58.715390 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3950-3892-4620-ae8a-c56a836888c8 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:58.759181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fa6d3-b289-44de-a91e-952bea658793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:58.759862 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fa6d3-b289-44de-a91e-952bea658793 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:58.759999 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fa6d3-b289-44de-a91e-952bea658793 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:58.760266 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fa6d3-b289-44de-a91e-952bea658793 None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:58.761034 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fa6d3-b289-44de-a91e-952bea658793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:40:58.761384 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fa6d3-b289-44de-a91e-952bea658793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:58.762910 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fa6d3-b289-44de-a91e-952bea658793 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:58.778559 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 426/852] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:40:58.786179 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768a69-0148-4e0c-8072-00c92b17f631 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:40:58.860416 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:58.908039 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768a69-0148-4e0c-8072-00c92b17f631 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:40:58.945221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ca2bf-cf5c-49ab-be39-8a5f7b1c095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:40:58.945890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca2bf-cf5c-49ab-be39-8a5f7b1c095b None admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:40:58.946166 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca2bf-cf5c-49ab-be39-8a5f7b1c095b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:40:58.946444 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca2bf-cf5c-49ab-be39-8a5f7b1c095b None admin] PATH_INFO: `/v3/projects/8626e1dba10a49f2a16ae81553658423/users/88caaed0c8c4438ea57d2f313fcf287a/roles/7a5931f5b557440d8144632a8e5834e6` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:40:58.966625 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ca2bf-cf5c-49ab-be39-8a5f7b1c095b None admin] RBAC: Authorizing `identity:create_grant(project_id=8626e1dba10a49f2a16ae81553658423, user_id=88caaed0c8c4438ea57d2f313fcf287a, role_id=7a5931f5b557440d8144632a8e5834e6)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:40:58.968165 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ca2bf-cf5c-49ab-be39-8a5f7b1c095b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:40:59.051061 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 427/853] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:40:58 2022] PUT /identity/v3/projects/8626e1dba10a49f2a16ae81553658423/users/88caaed0c8c4438ea57d2f313fcf287a/roles/7a5931f5b557440d8144632a8e5834e6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:41:01.590442 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112091c5-bf7f-4bf9-915b-bc965c296d35 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:01.591001 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112091c5-bf7f-4bf9-915b-bc965c296d35 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:01.591001 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112091c5-bf7f-4bf9-915b-bc965c296d35 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:01.592367 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 427/854] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:41:01.597712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd4f6a-0550-4eec-8c26-b67791db81af None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:01.598162 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd4f6a-0550-4eec-8c26-b67791db81af None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:01.601049 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd4f6a-0550-4eec-8c26-b67791db81af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:01.616651 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-f8fd4f6a-0550-4eec-8c26-b67791db81af None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:41:01.618312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-f8fd4f6a-0550-4eec-8c26-b67791db81af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:41:01.688715 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 428/855] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:41:01 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:41:02.016812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112091c5-bf7f-4bf9-915b-bc965c296d35 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:02.041517 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:02.114353 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112091c5-bf7f-4bf9-915b-bc965c296d35 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:02.146879 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195670f-3bc1-47c0-a728-90ab0099fa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:02.147490 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195670f-3bc1-47c0-a728-90ab0099fa2c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:02.147763 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195670f-3bc1-47c0-a728-90ab0099fa2c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:02.148027 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195670f-3bc1-47c0-a728-90ab0099fa2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:02.158149 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195670f-3bc1-47c0-a728-90ab0099fa2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-4195670f-3bc1-47c0-a728-90ab0099fa2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:41:02.162817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:02.163997 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:02.164914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 428/856] 10.222.0.52 () {56 vars in 1102 bytes} [Sat Sep 17 20:41:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:02.169976 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd4f6a-0550-4eec-8c26-b67791db81af None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:02.213929 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:02.269223 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd4f6a-0550-4eec-8c26-b67791db81af None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:02.302455 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807ff65-a31f-4aea-9262-9ee503e7892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:02.303034 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807ff65-a31f-4aea-9262-9ee503e7892a None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:02.303306 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807ff65-a31f-4aea-9262-9ee503e7892a None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:02.303571 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807ff65-a31f-4aea-9262-9ee503e7892a None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:02.304219 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807ff65-a31f-4aea-9262-9ee503e7892a None admin] RBAC: Adding query filter params (name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:02.304514 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807ff65-a31f-4aea-9262-9ee503e7892a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:02.305892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807ff65-a31f-4aea-9262-9ee503e7892a None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:02.314360 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 429/857] 10.222.0.52 () {56 vars in 1103 bytes} [Sat Sep 17 20:41:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:02.320286 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195670f-3bc1-47c0-a728-90ab0099fa2c None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:02.403453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:02.419249 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195670f-3bc1-47c0-a728-90ab0099fa2c None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:02.455984 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5828-b773-4dd1-a322-454494b16cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:02.456612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5828-b773-4dd1-a322-454494b16cf8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:02.456891 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5828-b773-4dd1-a322-454494b16cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:02.457189 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5828-b773-4dd1-a322-454494b16cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:02.467174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5828-b773-4dd1-a322-454494b16cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:02.469410 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5828-b773-4dd1-a322-454494b16cf8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-abdb5828-b773-4dd1-a322-454494b16cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:41:02.483750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:02.484938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:41:02.486010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:41:02.486010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:02.486010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:02.486010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 429/858] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:02.491023 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807ff65-a31f-4aea-9262-9ee503e7892a None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:02.593058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807ff65-a31f-4aea-9262-9ee503e7892a None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:02.596037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:02.628200 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0148001-00bb-482d-94c2-abfb33fb64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:02.628831 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0148001-00bb-482d-94c2-abfb33fb64ba None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:02.629051 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0148001-00bb-482d-94c2-abfb33fb64ba None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:02.629350 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0148001-00bb-482d-94c2-abfb33fb64ba None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:02.629974 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0148001-00bb-482d-94c2-abfb33fb64ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:02.630270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0148001-00bb-482d-94c2-abfb33fb64ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:02.631848 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0148001-00bb-482d-94c2-abfb33fb64ba None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:02.643477 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 430/859] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:02.649154 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5828-b773-4dd1-a322-454494b16cf8 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:02.747727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5828-b773-4dd1-a322-454494b16cf8 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:02.780852 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac421-ae8f-46bb-8ae2-9f6ed8393a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:02.781504 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac421-ae8f-46bb-8ae2-9f6ed8393a26 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:02.781780 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac421-ae8f-46bb-8ae2-9f6ed8393a26 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:02.782051 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac421-ae8f-46bb-8ae2-9f6ed8393a26 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:02.784650 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:02.789738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaac421-ae8f-46bb-8ae2-9f6ed8393a26 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:02.791158 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaac421-ae8f-46bb-8ae2-9f6ed8393a26 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-ceaac421-ae8f-46bb-8ae2-9f6ed8393a26 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:41:02.804438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:02.807847 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:02.808903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 430/860] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:02.813151 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0148001-00bb-482d-94c2-abfb33fb64ba None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:02.909501 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0148001-00bb-482d-94c2-abfb33fb64ba None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:02.942979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de858b-e046-4a2e-a231-b036413ae4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:02.943564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de858b-e046-4a2e-a231-b036413ae4c9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:02.943839 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de858b-e046-4a2e-a231-b036413ae4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:02.944108 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de858b-e046-4a2e-a231-b036413ae4c9 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:02.944815 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de858b-e046-4a2e-a231-b036413ae4c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:02.945114 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de858b-e046-4a2e-a231-b036413ae4c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:02.946631 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de858b-e046-4a2e-a231-b036413ae4c9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:02.963432 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 431/861] 10.222.0.52 () {56 vars in 1143 bytes} [Sat Sep 17 20:41:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:02.970449 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac421-ae8f-46bb-8ae2-9f6ed8393a26 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:03.068574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac421-ae8f-46bb-8ae2-9f6ed8393a26 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:03.102279 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929a4f6-44d1-4d6c-91fc-ee35a6698ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:03.102952 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a4f6-44d1-4d6c-91fc-ee35a6698ef4 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:03.103191 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a4f6-44d1-4d6c-91fc-ee35a6698ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:03.103459 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a4f6-44d1-4d6c-91fc-ee35a6698ef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:03.164768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:03.170894 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929a4f6-44d1-4d6c-91fc-ee35a6698ef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:03.177898 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929a4f6-44d1-4d6c-91fc-ee35a6698ef4 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:03.268341 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 431/862] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:41:02 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:03.274167 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de858b-e046-4a2e-a231-b036413ae4c9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:03.299592 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:03.372678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de858b-e046-4a2e-a231-b036413ae4c9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:03.407538 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934746f-cc16-42d8-b5e8-08e2cc3a9349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:03.408145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934746f-cc16-42d8-b5e8-08e2cc3a9349 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:03.408426 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934746f-cc16-42d8-b5e8-08e2cc3a9349 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:03.408698 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934746f-cc16-42d8-b5e8-08e2cc3a9349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:03.418960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934746f-cc16-42d8-b5e8-08e2cc3a9349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:03.420371 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934746f-cc16-42d8-b5e8-08e2cc3a9349 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-3934746f-cc16-42d8-b5e8-08e2cc3a9349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:41:03.434717 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:03.435836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:41:03.436720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:41:03.436720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:03.436720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:03.436720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 432/863] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:03.442016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929a4f6-44d1-4d6c-91fc-ee35a6698ef4 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:03.536213 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:03.541432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929a4f6-44d1-4d6c-91fc-ee35a6698ef4 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:03.573746 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ed33b-2794-4083-8536-c586c6fe10fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:03.574352 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ed33b-2794-4083-8536-c586c6fe10fc None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:03.574631 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ed33b-2794-4083-8536-c586c6fe10fc None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:03.575164 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ed33b-2794-4083-8536-c586c6fe10fc None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:03.575797 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ed33b-2794-4083-8536-c586c6fe10fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:03.576098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ed33b-2794-4083-8536-c586c6fe10fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:03.577497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ed33b-2794-4083-8536-c586c6fe10fc None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:03.588980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 432/864] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:03.595434 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934746f-cc16-42d8-b5e8-08e2cc3a9349 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:03.672513 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:03.706266 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934746f-cc16-42d8-b5e8-08e2cc3a9349 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:03.742655 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e3f15-edc9-471d-812f-298ba7ddca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:03.743274 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3f15-edc9-471d-812f-298ba7ddca2b None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:03.743551 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3f15-edc9-471d-812f-298ba7ddca2b None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:03.743824 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3f15-edc9-471d-812f-298ba7ddca2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:03.751046 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e3f15-edc9-471d-812f-298ba7ddca2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:03.752474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e3f15-edc9-471d-812f-298ba7ddca2b None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-c73e3f15-edc9-471d-812f-298ba7ddca2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:41:03.763406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:03.764440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:03.766356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:41:03.766356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:41:03.766356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:41:03.766356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:41:03.766356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:41:03.766356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:41:03.766356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:41:03.766356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:03.766356 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 433/865] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:41:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:03.771169 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ed33b-2794-4083-8536-c586c6fe10fc None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:03.874137 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ed33b-2794-4083-8536-c586c6fe10fc None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:03.907620 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de47a8-3983-4afa-8b43-77ea8b7109c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:03.908221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de47a8-3983-4afa-8b43-77ea8b7109c9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:03.908500 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de47a8-3983-4afa-8b43-77ea8b7109c9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:03.908772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de47a8-3983-4afa-8b43-77ea8b7109c9 None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:03.909489 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de47a8-3983-4afa-8b43-77ea8b7109c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:03.909794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de47a8-3983-4afa-8b43-77ea8b7109c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:03.911217 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de47a8-3983-4afa-8b43-77ea8b7109c9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:03.922945 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 433/866] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:41:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:03.929060 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e3f15-edc9-471d-812f-298ba7ddca2b None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:04.028981 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e3f15-edc9-471d-812f-298ba7ddca2b None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:04.062443 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f0c9a-962e-4b90-8891-5a71602c2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:04.063035 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0c9a-962e-4b90-8891-5a71602c2c27 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:04.065122 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0c9a-962e-4b90-8891-5a71602c2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:04.065122 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0c9a-962e-4b90-8891-5a71602c2c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:04.065122 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f0c9a-962e-4b90-8891-5a71602c2c27 None admin] RBAC: Adding query filter params (role.id=7a5931f5b557440d8144632a8e5834e6, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=88caaed0c8c4438ea57d2f313fcf287a) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:04.065122 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f0c9a-962e-4b90-8891-5a71602c2c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:04.066061 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f0c9a-962e-4b90-8891-5a71602c2c27 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:04.067848 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:04.072237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 434/867] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:41:03 2022] GET /identity/v3/role_assignments?user.id=88caaed0c8c4438ea57d2f313fcf287a&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=7a5931f5b557440d8144632a8e5834e6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:06.501139 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdaad8-9323-46f7-9d9b-95480a873787 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:06.501704 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdaad8-9323-46f7-9d9b-95480a873787 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:06.501704 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdaad8-9323-46f7-9d9b-95480a873787 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:06.503152 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 434/868] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:41:06.508502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2d5e-4030-495c-940e-e20be13a366f None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:06.508927 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2d5e-4030-495c-940e-e20be13a366f None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:06.509033 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2d5e-4030-495c-940e-e20be13a366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:06.526881 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-08fa2d5e-4030-495c-940e-e20be13a366f None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:41:06.528057 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-08fa2d5e-4030-495c-940e-e20be13a366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:41:06.595352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 435/869] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:41:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:41:06.925060 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdaad8-9323-46f7-9d9b-95480a873787 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:06.943651 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:07.026290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdaad8-9323-46f7-9d9b-95480a873787 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:07.061896 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404294f-15fc-4b4d-b32a-36ef438c74d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:07.062634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404294f-15fc-4b4d-b32a-36ef438c74d7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:07.062815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404294f-15fc-4b4d-b32a-36ef438c74d7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:07.063165 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404294f-15fc-4b4d-b32a-36ef438c74d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:07.073650 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404294f-15fc-4b4d-b32a-36ef438c74d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-4404294f-15fc-4b4d-b32a-36ef438c74d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:41:07.078853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:07.080099 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:07.081201 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 435/870] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:41:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:07.086263 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa2d5e-4030-495c-940e-e20be13a366f None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:07.190899 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa2d5e-4030-495c-940e-e20be13a366f None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:07.216710 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:07.225294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5772df-8638-42a8-b24a-d829fb469983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:07.225907 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5772df-8638-42a8-b24a-d829fb469983 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:07.226174 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5772df-8638-42a8-b24a-d829fb469983 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:07.226491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5772df-8638-42a8-b24a-d829fb469983 None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:07.227110 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5772df-8638-42a8-b24a-d829fb469983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:07.227404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5772df-8638-42a8-b24a-d829fb469983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:07.228769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5772df-8638-42a8-b24a-d829fb469983 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:07.240256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 436/871] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:07.246220 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404294f-15fc-4b4d-b32a-36ef438c74d7 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:07.323858 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:07.347708 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404294f-15fc-4b4d-b32a-36ef438c74d7 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:07.380935 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08952b02-1e83-4019-a0b4-b8e412befb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:07.381587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08952b02-1e83-4019-a0b4-b8e412befb38 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:07.381864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08952b02-1e83-4019-a0b4-b8e412befb38 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:07.382136 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08952b02-1e83-4019-a0b4-b8e412befb38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:07.392923 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08952b02-1e83-4019-a0b4-b8e412befb38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:07.394392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08952b02-1e83-4019-a0b4-b8e412befb38 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-08952b02-1e83-4019-a0b4-b8e412befb38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:41:07.412392 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:07.414049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:41:07.415842 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:41:07.415842 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:07.415842 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:07.417325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 436/872] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:07.419399 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5772df-8638-42a8-b24a-d829fb469983 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:07.520093 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5772df-8638-42a8-b24a-d829fb469983 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:07.553588 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b7d3-80f3-4203-9cb2-38f1917158c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:07.554192 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b7d3-80f3-4203-9cb2-38f1917158c8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:07.554467 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b7d3-80f3-4203-9cb2-38f1917158c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:07.554738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b7d3-80f3-4203-9cb2-38f1917158c8 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:07.555404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250b7d3-80f3-4203-9cb2-38f1917158c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:07.555714 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250b7d3-80f3-4203-9cb2-38f1917158c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:07.557074 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250b7d3-80f3-4203-9cb2-38f1917158c8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:07.569441 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 437/873] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:07.575581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08952b02-1e83-4019-a0b4-b8e412befb38 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:07.674587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08952b02-1e83-4019-a0b4-b8e412befb38 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:07.700771 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:07.709119 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc2b08-61a6-46c8-89e4-85a56f10cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:07.709821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc2b08-61a6-46c8-89e4-85a56f10cd78 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:07.710096 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc2b08-61a6-46c8-89e4-85a56f10cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:07.710363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc2b08-61a6-46c8-89e4-85a56f10cd78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:07.718016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc2b08-61a6-46c8-89e4-85a56f10cd78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:07.719707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc2b08-61a6-46c8-89e4-85a56f10cd78 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-3cbc2b08-61a6-46c8-89e4-85a56f10cd78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:41:07.730720 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:07.738450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:07.739655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 437/874] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:07.740460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b7d3-80f3-4203-9cb2-38f1917158c8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:07.791323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:07.840451 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b7d3-80f3-4203-9cb2-38f1917158c8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:07.872985 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c57b7d-ecd3-4108-b814-8df9992b67d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:07.873586 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c57b7d-ecd3-4108-b814-8df9992b67d8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:07.873861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c57b7d-ecd3-4108-b814-8df9992b67d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:07.874152 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c57b7d-ecd3-4108-b814-8df9992b67d8 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:07.875440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c57b7d-ecd3-4108-b814-8df9992b67d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:07.875736 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c57b7d-ecd3-4108-b814-8df9992b67d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:07.877135 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c57b7d-ecd3-4108-b814-8df9992b67d8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:07.893497 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 438/875] 10.222.0.52 () {56 vars in 1143 bytes} [Sat Sep 17 20:41:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:07.899239 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc2b08-61a6-46c8-89e4-85a56f10cd78 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:07.997867 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc2b08-61a6-46c8-89e4-85a56f10cd78 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:08.033812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84300a-7107-4258-a847-96589bb3d464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:08.034413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84300a-7107-4258-a847-96589bb3d464 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:08.034696 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84300a-7107-4258-a847-96589bb3d464 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:08.034970 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84300a-7107-4258-a847-96589bb3d464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:08.089656 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:08.101552 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84300a-7107-4258-a847-96589bb3d464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:08.102946 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84300a-7107-4258-a847-96589bb3d464 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:08.198854 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 438/876] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:41:07 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:08.205045 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c57b7d-ecd3-4108-b814-8df9992b67d8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:08.303322 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c57b7d-ecd3-4108-b814-8df9992b67d8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:08.313040 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:08.339224 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a90c21-2cd1-425d-96c9-428e4e1027b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:08.339846 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a90c21-2cd1-425d-96c9-428e4e1027b2 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:08.340127 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a90c21-2cd1-425d-96c9-428e4e1027b2 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:08.340401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a90c21-2cd1-425d-96c9-428e4e1027b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:08.350224 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a90c21-2cd1-425d-96c9-428e4e1027b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:08.351854 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a90c21-2cd1-425d-96c9-428e4e1027b2 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-40a90c21-2cd1-425d-96c9-428e4e1027b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:41:08.366270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:08.367340 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:41:08.368228 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:41:08.368228 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:08.368228 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:08.368228 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 439/877] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:08.373252 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84300a-7107-4258-a847-96589bb3d464 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:08.459685 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:08.471900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84300a-7107-4258-a847-96589bb3d464 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:08.505938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec22faa-ad8b-429b-b887-14f730918b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:08.506546 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec22faa-ad8b-429b-b887-14f730918b08 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:08.506824 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec22faa-ad8b-429b-b887-14f730918b08 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:08.507095 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec22faa-ad8b-429b-b887-14f730918b08 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:08.507727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec22faa-ad8b-429b-b887-14f730918b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:08.508027 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec22faa-ad8b-429b-b887-14f730918b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:08.509437 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec22faa-ad8b-429b-b887-14f730918b08 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:08.520396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 439/878] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:08.526302 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a90c21-2cd1-425d-96c9-428e4e1027b2 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:08.629770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a90c21-2cd1-425d-96c9-428e4e1027b2 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:08.662811 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92fb9a-7bb3-405d-a8fe-066304953fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:08.663420 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92fb9a-7bb3-405d-a8fe-066304953fdd None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:08.663698 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92fb9a-7bb3-405d-a8fe-066304953fdd None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:08.663967 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92fb9a-7bb3-405d-a8fe-066304953fdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:08.670320 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92fb9a-7bb3-405d-a8fe-066304953fdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:08.671881 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92fb9a-7bb3-405d-a8fe-066304953fdd None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-dd92fb9a-7bb3-405d-a8fe-066304953fdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:41:08.682853 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:08.683959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:08.685136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:41:08.685136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:41:08.685136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:41:08.685136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:41:08.685136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:41:08.685136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:41:08.685136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:41:08.685136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:08.685136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 440/879] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:41:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:08.690263 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec22faa-ad8b-429b-b887-14f730918b08 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:08.797762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec22faa-ad8b-429b-b887-14f730918b08 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:08.836393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639f8f9-cb88-43ee-a90b-a26df89d73e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:08.837000 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f8f9-cb88-43ee-a90b-a26df89d73e7 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:08.837319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f8f9-cb88-43ee-a90b-a26df89d73e7 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:08.837595 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f8f9-cb88-43ee-a90b-a26df89d73e7 None admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:08.838282 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f8f9-cb88-43ee-a90b-a26df89d73e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:08.838589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f8f9-cb88-43ee-a90b-a26df89d73e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:08.840021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f8f9-cb88-43ee-a90b-a26df89d73e7 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:08.851905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 440/880] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:41:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:08.858042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92fb9a-7bb3-405d-a8fe-066304953fdd None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:08.881642 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:08.958437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92fb9a-7bb3-405d-a8fe-066304953fdd None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:08.991957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d678a8-cb64-4306-b145-d3ca4536b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:08.992550 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d678a8-cb64-4306-b145-d3ca4536b4ad None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:08.992825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d678a8-cb64-4306-b145-d3ca4536b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:08.993097 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d678a8-cb64-4306-b145-d3ca4536b4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:08.993838 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d678a8-cb64-4306-b145-d3ca4536b4ad None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=88caaed0c8c4438ea57d2f313fcf287a) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:08.994147 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d678a8-cb64-4306-b145-d3ca4536b4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:08.995648 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d678a8-cb64-4306-b145-d3ca4536b4ad None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:09.001297 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 441/881] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:41:08 2022] GET /identity/v3/role_assignments?user.id=88caaed0c8c4438ea57d2f313fcf287a&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:11.353878 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e22b77-48fb-4447-9b57-9e950d8c83e4 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:11.354441 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e22b77-48fb-4447-9b57-9e950d8c83e4 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:11.354441 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e22b77-48fb-4447-9b57-9e950d8c83e4 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:11.355647 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 441/882] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:41:11.361115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f6ef-f80a-4577-aa98-c5c4b2867892 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:11.361560 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f6ef-f80a-4577-aa98-c5c4b2867892 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:11.361686 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f6ef-f80a-4577-aa98-c5c4b2867892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:11.383248 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-b060f6ef-f80a-4577-aa98-c5c4b2867892 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:41:11.387302 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-b060f6ef-f80a-4577-aa98-c5c4b2867892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:41:11.451424 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 442/883] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:41:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:41:11.775089 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e22b77-48fb-4447-9b57-9e950d8c83e4 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:11.786066 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:11.874626 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e22b77-48fb-4447-9b57-9e950d8c83e4 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:11.907000 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00f760-8914-449b-940a-032d88bcaa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:11.908185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00f760-8914-449b-940a-032d88bcaa92 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:11.908185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00f760-8914-449b-940a-032d88bcaa92 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:11.908185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00f760-8914-449b-940a-032d88bcaa92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:11.917607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00f760-8914-449b-940a-032d88bcaa92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-9d00f760-8914-449b-940a-032d88bcaa92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:41:11.922916 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:11.923922 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:11.924756 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 442/884] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:11.930111 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060f6ef-f80a-4577-aa98-c5c4b2867892 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:11.945880 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:12.029919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060f6ef-f80a-4577-aa98-c5c4b2867892 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:12.065809 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a973f00-9f00-4ec7-817b-fc2fb291c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:12.066526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a973f00-9f00-4ec7-817b-fc2fb291c1bb None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:12.066807 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a973f00-9f00-4ec7-817b-fc2fb291c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:12.067076 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a973f00-9f00-4ec7-817b-fc2fb291c1bb None admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:12.067740 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a973f00-9f00-4ec7-817b-fc2fb291c1bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:12.068039 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a973f00-9f00-4ec7-817b-fc2fb291c1bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:12.069428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a973f00-9f00-4ec7-817b-fc2fb291c1bb None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:12.079376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 443/885] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:41:12.085737 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00f760-8914-449b-940a-032d88bcaa92 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:12.165037 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:12.201041 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00f760-8914-449b-940a-032d88bcaa92 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:12.237673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b49a1-6128-4591-93ae-185ab44a5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:12.238356 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b49a1-6128-4591-93ae-185ab44a5311 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:12.238629 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b49a1-6128-4591-93ae-185ab44a5311 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:12.238896 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b49a1-6128-4591-93ae-185ab44a5311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:12.251896 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b49a1-6128-4591-93ae-185ab44a5311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:12.253447 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b49a1-6128-4591-93ae-185ab44a5311 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-242b49a1-6128-4591-93ae-185ab44a5311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:41:12.269185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:12.270221 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:41:12.271106 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:41:12.271106 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:12.271106 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:12.273511 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 443/886] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:12.276279 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a973f00-9f00-4ec7-817b-fc2fb291c1bb None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:12.360912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:12.385105 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a973f00-9f00-4ec7-817b-fc2fb291c1bb None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:12.420971 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0abc44-b8b8-427f-9d9d-94b6bd5829fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:12.422191 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0abc44-b8b8-427f-9d9d-94b6bd5829fc None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:12.422457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0abc44-b8b8-427f-9d9d-94b6bd5829fc None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:12.422729 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0abc44-b8b8-427f-9d9d-94b6bd5829fc None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:12.423363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0abc44-b8b8-427f-9d9d-94b6bd5829fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:12.423765 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0abc44-b8b8-427f-9d9d-94b6bd5829fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:12.425153 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0abc44-b8b8-427f-9d9d-94b6bd5829fc None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:12.438977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 444/887] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:41:12.444563 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b49a1-6128-4591-93ae-185ab44a5311 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:12.549611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b49a1-6128-4591-93ae-185ab44a5311 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:12.569842 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:12.584625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ed7d9-8c12-425f-85c7-2606963b47ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:12.585278 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ed7d9-8c12-425f-85c7-2606963b47ec None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:12.585564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ed7d9-8c12-425f-85c7-2606963b47ec None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:12.585830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ed7d9-8c12-425f-85c7-2606963b47ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:12.594585 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ed7d9-8c12-425f-85c7-2606963b47ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:12.596019 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ed7d9-8c12-425f-85c7-2606963b47ec None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-145ed7d9-8c12-425f-85c7-2606963b47ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:41:12.607461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:12.611612 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:12.612795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 444/888] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:12.617796 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0abc44-b8b8-427f-9d9d-94b6bd5829fc None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:12.719868 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0abc44-b8b8-427f-9d9d-94b6bd5829fc None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:12.753801 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4f6f1-51db-4ae2-ba76-5ed1d3b26ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:12.754398 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f6f1-51db-4ae2-ba76-5ed1d3b26ee8 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:12.754678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f6f1-51db-4ae2-ba76-5ed1d3b26ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:12.754951 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f6f1-51db-4ae2-ba76-5ed1d3b26ee8 None admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:12.755702 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4f6f1-51db-4ae2-ba76-5ed1d3b26ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:12.756216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4f6f1-51db-4ae2-ba76-5ed1d3b26ee8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:12.757673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4f6f1-51db-4ae2-ba76-5ed1d3b26ee8 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:12.760267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:12.775455 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 445/889] 10.222.0.52 () {56 vars in 1143 bytes} [Sat Sep 17 20:41:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:12.781351 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ed7d9-8c12-425f-85c7-2606963b47ec None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:12.882399 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ed7d9-8c12-425f-85c7-2606963b47ec None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:12.915397 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b390e8a-113d-4186-9308-cb23b827f0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:12.916020 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b390e8a-113d-4186-9308-cb23b827f0bd None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:12.916300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b390e8a-113d-4186-9308-cb23b827f0bd None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:12.916574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b390e8a-113d-4186-9308-cb23b827f0bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:12.927251 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b390e8a-113d-4186-9308-cb23b827f0bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:12.928688 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b390e8a-113d-4186-9308-cb23b827f0bd None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-8b390e8a-113d-4186-9308-cb23b827f0bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:41:12.943364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:12.944445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:41:12.945532 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:41:12.945532 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:12.945532 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:12.945532 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 445/890] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:12.950269 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4f6f1-51db-4ae2-ba76-5ed1d3b26ee8 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:13.049183 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4f6f1-51db-4ae2-ba76-5ed1d3b26ee8 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:13.083231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a672ca-465b-43b6-bf5d-f28000e3a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:13.083816 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a672ca-465b-43b6-bf5d-f28000e3a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:13.084091 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a672ca-465b-43b6-bf5d-f28000e3a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:13.084358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a672ca-465b-43b6-bf5d-f28000e3a4c0 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:13.084982 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a672ca-465b-43b6-bf5d-f28000e3a4c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:13.085310 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a672ca-465b-43b6-bf5d-f28000e3a4c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:13.086656 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a672ca-465b-43b6-bf5d-f28000e3a4c0 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:13.097587 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 446/891] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:41:13.103410 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b390e8a-113d-4186-9308-cb23b827f0bd None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:13.136073 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:13.202929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b390e8a-113d-4186-9308-cb23b827f0bd None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:13.234817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c5645-cb14-4a88-b08f-512f26cddbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:13.235519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c5645-cb14-4a88-b08f-512f26cddbd9 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:13.235795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c5645-cb14-4a88-b08f-512f26cddbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:13.236063 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c5645-cb14-4a88-b08f-512f26cddbd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:13.242406 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c5645-cb14-4a88-b08f-512f26cddbd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:13.243827 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c5645-cb14-4a88-b08f-512f26cddbd9 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-8b2c5645-cb14-4a88-b08f-512f26cddbd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:41:13.256772 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:13.257845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:13.259074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:41:13.259074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:41:13.259074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:41:13.259074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:41:13.259074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:41:13.259074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:41:13.259074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:41:13.259074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:13.259074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 446/892] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:13.263730 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a672ca-465b-43b6-bf5d-f28000e3a4c0 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:13.319347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:13.364604 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a672ca-465b-43b6-bf5d-f28000e3a4c0 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:13.397714 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef6ddf-e3c3-49d9-b1f7-dac85ed5be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:13.398349 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6ddf-e3c3-49d9-b1f7-dac85ed5be46 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:13.398613 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6ddf-e3c3-49d9-b1f7-dac85ed5be46 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:13.398890 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6ddf-e3c3-49d9-b1f7-dac85ed5be46 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:13.399571 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef6ddf-e3c3-49d9-b1f7-dac85ed5be46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:13.399878 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef6ddf-e3c3-49d9-b1f7-dac85ed5be46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:13.401319 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef6ddf-e3c3-49d9-b1f7-dac85ed5be46 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:13.414152 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 447/893] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:13.420244 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c5645-cb14-4a88-b08f-512f26cddbd9 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:13.514651 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:13.523406 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c5645-cb14-4a88-b08f-512f26cddbd9 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:13.557573 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a32904-2e8c-47e1-99b3-8bfd30104480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:13.558218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a32904-2e8c-47e1-99b3-8bfd30104480 None admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:13.558496 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a32904-2e8c-47e1-99b3-8bfd30104480 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:13.558766 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a32904-2e8c-47e1-99b3-8bfd30104480 None admin] PATH_INFO: `/v3/projects/8626e1dba10a49f2a16ae81553658423/users/88caaed0c8c4438ea57d2f313fcf287a/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:13.560634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a32904-2e8c-47e1-99b3-8bfd30104480 None admin] RBAC: Authorizing `identity:create_grant(project_id=8626e1dba10a49f2a16ae81553658423, user_id=88caaed0c8c4438ea57d2f313fcf287a, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:13.562094 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a32904-2e8c-47e1-99b3-8bfd30104480 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:13.650187 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 447/894] 10.222.0.52 () {58 vars in 1439 bytes} [Sat Sep 17 20:41:13 2022] PUT /identity/v3/projects/8626e1dba10a49f2a16ae81553658423/users/88caaed0c8c4438ea57d2f313fcf287a/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:41:16.074287 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a464a-538c-4a8f-8469-4d642e07971c None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:16.074790 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a464a-538c-4a8f-8469-4d642e07971c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:16.074790 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a464a-538c-4a8f-8469-4d642e07971c None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:16.076328 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 448/895] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:41:16.082653 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f73970-1c3f-440a-b927-ee6bdc3c2b7c None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:16.083065 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f73970-1c3f-440a-b927-ee6bdc3c2b7c None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:16.083204 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f73970-1c3f-440a-b927-ee6bdc3c2b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:16.101462 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-15f73970-1c3f-440a-b927-ee6bdc3c2b7c None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:41:16.102643 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-15f73970-1c3f-440a-b927-ee6bdc3c2b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:41:16.168074 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 448/896] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:41:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:41:16.494511 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a464a-538c-4a8f-8469-4d642e07971c None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:16.595788 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a464a-538c-4a8f-8469-4d642e07971c None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:16.610395 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:16.629375 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8ea0-5922-4082-9cdd-ea16e8a9c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:16.629980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8ea0-5922-4082-9cdd-ea16e8a9c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:16.630401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8ea0-5922-4082-9cdd-ea16e8a9c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:16.630672 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8ea0-5922-4082-9cdd-ea16e8a9c6e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:16.640270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef8ea0-5922-4082-9cdd-ea16e8a9c6e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-85ef8ea0-5922-4082-9cdd-ea16e8a9c6e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 20:41:16.645182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:16.646271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:16.647437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 449/897] 10.222.0.52 () {56 vars in 1096 bytes} [Sat Sep 17 20:41:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:16.652251 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f73970-1c3f-440a-b927-ee6bdc3c2b7c None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:16.743468 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:16.760857 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f73970-1c3f-440a-b927-ee6bdc3c2b7c None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:16.793979 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a3da5-9523-4339-939e-53a520da5b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:16.794598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a3da5-9523-4339-939e-53a520da5b39 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:16.795230 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a3da5-9523-4339-939e-53a520da5b39 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:16.795579 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a3da5-9523-4339-939e-53a520da5b39 None admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:16.796238 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a3da5-9523-4339-939e-53a520da5b39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:16.796539 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a3da5-9523-4339-939e-53a520da5b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:16.798650 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a3da5-9523-4339-939e-53a520da5b39 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:16.806730 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 449/898] 10.222.0.52 () {56 vars in 1099 bytes} [Sat Sep 17 20:41:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:16.813037 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8ea0-5922-4082-9cdd-ea16e8a9c6e0 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:16.913076 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8ea0-5922-4082-9cdd-ea16e8a9c6e0 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:16.946441 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ceb96-ff36-4c1e-9478-367a5f177d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:16.947058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ceb96-ff36-4c1e-9478-367a5f177d83 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:16.947335 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ceb96-ff36-4c1e-9478-367a5f177d83 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:16.947607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ceb96-ff36-4c1e-9478-367a5f177d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:16.958216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ceb96-ff36-4c1e-9478-367a5f177d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:16.959651 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ceb96-ff36-4c1e-9478-367a5f177d83 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-bb1ceb96-ff36-4c1e-9478-367a5f177d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:41:16.974725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:16.977923 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:41:16.979007 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:41:16.979007 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:16.979007 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:16.979007 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 450/899] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 20:41:16.981777 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a3da5-9523-4339-939e-53a520da5b39 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:17.081923 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a3da5-9523-4339-939e-53a520da5b39 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:17.115226 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6c644-fd51-4e0a-8cc4-b385d75777b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:17.115865 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6c644-fd51-4e0a-8cc4-b385d75777b8 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:17.116102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6c644-fd51-4e0a-8cc4-b385d75777b8 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:17.116376 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6c644-fd51-4e0a-8cc4-b385d75777b8 None admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:17.117019 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6c644-fd51-4e0a-8cc4-b385d75777b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:17.117347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6c644-fd51-4e0a-8cc4-b385d75777b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:17.118727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6c644-fd51-4e0a-8cc4-b385d75777b8 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:17.130952 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 450/900] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:17.136708 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ceb96-ff36-4c1e-9478-367a5f177d83 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:17.165491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:17.236611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ceb96-ff36-4c1e-9478-367a5f177d83 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:17.270782 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260c637-f6ff-4e5e-a884-843261e2f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:17.271398 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c637-f6ff-4e5e-a884-843261e2f187 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:17.271671 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c637-f6ff-4e5e-a884-843261e2f187 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:17.271936 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c637-f6ff-4e5e-a884-843261e2f187 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:17.279187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260c637-f6ff-4e5e-a884-843261e2f187 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:17.280603 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260c637-f6ff-4e5e-a884-843261e2f187 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-2260c637-f6ff-4e5e-a884-843261e2f187 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 20:41:17.291969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:17.292910 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:17.293960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 451/901] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:17.299343 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6c644-fd51-4e0a-8cc4-b385d75777b8 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:17.303182 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:17.394091 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6c644-fd51-4e0a-8cc4-b385d75777b8 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:17.425507 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573d3f9-3f0e-48b0-b7e1-98d059aa77fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:17.426086 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573d3f9-3f0e-48b0-b7e1-98d059aa77fa None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:17.426359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573d3f9-3f0e-48b0-b7e1-98d059aa77fa None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:17.426625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573d3f9-3f0e-48b0-b7e1-98d059aa77fa None admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:17.427326 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573d3f9-3f0e-48b0-b7e1-98d059aa77fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:17.427625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573d3f9-3f0e-48b0-b7e1-98d059aa77fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:17.429031 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573d3f9-3f0e-48b0-b7e1-98d059aa77fa None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:17.446760 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 451/902] 10.222.0.52 () {56 vars in 1143 bytes} [Sat Sep 17 20:41:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:17.452678 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260c637-f6ff-4e5e-a884-843261e2f187 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:17.538577 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:17.552792 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260c637-f6ff-4e5e-a884-843261e2f187 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:17.585306 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfb267-0068-41eb-bd62-811900b7fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:17.586553 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfb267-0068-41eb-bd62-811900b7fbbe None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:17.586553 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfb267-0068-41eb-bd62-811900b7fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:17.586553 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfb267-0068-41eb-bd62-811900b7fbbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:17.654056 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfb267-0068-41eb-bd62-811900b7fbbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:17.655475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfb267-0068-41eb-bd62-811900b7fbbe None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:17.736991 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:17.752524 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 452/903] 10.222.0.52 () {58 vars in 1282 bytes} [Sat Sep 17 20:41:17 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:17.758578 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573d3f9-3f0e-48b0-b7e1-98d059aa77fa None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:17.822551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:17.860523 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573d3f9-3f0e-48b0-b7e1-98d059aa77fa None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:17.894089 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c851090-8b46-46c1-9b94-1233ba2955bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:17.894707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c851090-8b46-46c1-9b94-1233ba2955bd None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:17.894978 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c851090-8b46-46c1-9b94-1233ba2955bd None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:17.895248 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c851090-8b46-46c1-9b94-1233ba2955bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:17.910616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c851090-8b46-46c1-9b94-1233ba2955bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:17.910616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c851090-8b46-46c1-9b94-1233ba2955bd None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-5c851090-8b46-46c1-9b94-1233ba2955bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 20:41:17.920339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:17.921738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 20:41:17.923794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 20:41:17.923794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 20:41:17.923794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:17.923794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 452/904] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:17.927782 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfb267-0068-41eb-bd62-811900b7fbbe None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:18.023753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfb267-0068-41eb-bd62-811900b7fbbe None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:18.057436 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247da2e3-0bce-48b8-871e-44ffed612a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:18.058025 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247da2e3-0bce-48b8-871e-44ffed612a82 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:18.058303 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247da2e3-0bce-48b8-871e-44ffed612a82 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:18.058576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247da2e3-0bce-48b8-871e-44ffed612a82 None admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:18.059205 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247da2e3-0bce-48b8-871e-44ffed612a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:18.059507 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247da2e3-0bce-48b8-871e-44ffed612a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:18.060861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247da2e3-0bce-48b8-871e-44ffed612a82 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:18.071675 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 453/905] 10.222.0.52 () {56 vars in 1109 bytes} [Sat Sep 17 20:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:18.077705 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c851090-8b46-46c1-9b94-1233ba2955bd None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:18.176610 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c851090-8b46-46c1-9b94-1233ba2955bd None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:18.190502 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:18.210579 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af0742-d804-44e8-a29f-9bf37407e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:18.211193 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af0742-d804-44e8-a29f-9bf37407e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:18.211469 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af0742-d804-44e8-a29f-9bf37407e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:18.211739 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af0742-d804-44e8-a29f-9bf37407e0e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:18.218301 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af0742-d804-44e8-a29f-9bf37407e0e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:18.220140 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af0742-d804-44e8-a29f-9bf37407e0e3 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application [None req-04af0742-d804-44e8-a29f-9bf37407e0e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 20:41:18.231359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:18.232448 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:18.233587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 20:41:18.233587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 20:41:18.233587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 20:41:18.233587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 20:41:18.233587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 20:41:18.233587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 20:41:18.233587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 20:41:18.233587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: ERROR keystone.server.flask.application Sep 17 20:41:18.233587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 453/906] 10.222.0.52 () {56 vars in 1111 bytes} [Sat Sep 17 20:41:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:18.238799 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247da2e3-0bce-48b8-871e-44ffed612a82 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:18.284901 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:18.336256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247da2e3-0bce-48b8-871e-44ffed612a82 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:18.369631 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04bd78-ac3c-4bd7-846c-822964c899f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:18.370217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04bd78-ac3c-4bd7-846c-822964c899f1 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:18.370490 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04bd78-ac3c-4bd7-846c-822964c899f1 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:18.370758 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04bd78-ac3c-4bd7-846c-822964c899f1 None admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:18.371427 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04bd78-ac3c-4bd7-846c-822964c899f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:18.371725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04bd78-ac3c-4bd7-846c-822964c899f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:18.373130 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04bd78-ac3c-4bd7-846c-822964c899f1 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:18.385406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 454/907] 10.222.0.52 () {56 vars in 1148 bytes} [Sat Sep 17 20:41:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:18.391614 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af0742-d804-44e8-a29f-9bf37407e0e3 None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:18.490674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af0742-d804-44e8-a29f-9bf37407e0e3 None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:18.523962 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb19422-dc44-4108-a646-ba9b9449db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:18.524562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb19422-dc44-4108-a646-ba9b9449db51 None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:18.524843 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb19422-dc44-4108-a646-ba9b9449db51 None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:18.525115 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb19422-dc44-4108-a646-ba9b9449db51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:18.525859 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb19422-dc44-4108-a646-ba9b9449db51 None admin] RBAC: Adding query filter params (role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a, scope.project.id=8626e1dba10a49f2a16ae81553658423, user.id=88caaed0c8c4438ea57d2f313fcf287a) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:18.526167 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb19422-dc44-4108-a646-ba9b9449db51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:18.527648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb19422-dc44-4108-a646-ba9b9449db51 None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:18.534909 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 454/908] 10.222.0.52 () {56 vars in 1374 bytes} [Sat Sep 17 20:41:18 2022] GET /identity/v3/role_assignments?user.id=88caaed0c8c4438ea57d2f313fcf287a&scope.project.id=8626e1dba10a49f2a16ae81553658423&role.id=b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:20.947238 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f29d9a-af80-4604-8217-ccb341e97f4e None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:20.947793 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f29d9a-af80-4604-8217-ccb341e97f4e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:20.947793 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f29d9a-af80-4604-8217-ccb341e97f4e None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:20.949134 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 455/909] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:41:20.955146 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527345e6-c17c-4ff5-8de1-33615b439872 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:20.955569 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527345e6-c17c-4ff5-8de1-33615b439872 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:20.955681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527345e6-c17c-4ff5-8de1-33615b439872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:20.974267 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-527345e6-c17c-4ff5-8de1-33615b439872 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:41:20.975490 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-527345e6-c17c-4ff5-8de1-33615b439872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:41:21.005050 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:21.042750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 455/910] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:41:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:41:21.410268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f29d9a-af80-4604-8217-ccb341e97f4e None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:21.511690 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f29d9a-af80-4604-8217-ccb341e97f4e None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:21.519605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:21.546084 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424aa19-e1db-43a3-b0ca-ce1a6538c9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:21.546692 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424aa19-e1db-43a3-b0ca-ce1a6538c9c9 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:21.547465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424aa19-e1db-43a3-b0ca-ce1a6538c9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:21.547738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424aa19-e1db-43a3-b0ca-ce1a6538c9c9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:21.548304 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424aa19-e1db-43a3-b0ca-ce1a6538c9c9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:21.549699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424aa19-e1db-43a3-b0ca-ce1a6538c9c9 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-3424aa19-e1db-43a3-b0ca-ce1a6538c9c9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:21.558527 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:21.561933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:21.563019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 456/911] 10.222.0.52 () {56 vars in 1117 bytes} [Sat Sep 17 20:41:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:21.566117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527345e6-c17c-4ff5-8de1-33615b439872 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:21.665513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527345e6-c17c-4ff5-8de1-33615b439872 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:21.700362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fe7af-77ec-4f29-82c4-d5c40dd26a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:21.701393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe7af-77ec-4f29-82c4-d5c40dd26a9c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:21.701714 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe7af-77ec-4f29-82c4-d5c40dd26a9c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:21.702021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe7af-77ec-4f29-82c4-d5c40dd26a9c None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:21.702675 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fe7af-77ec-4f29-82c4-d5c40dd26a9c None admin] RBAC: Adding query filter params (name=placement) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:21.703013 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fe7af-77ec-4f29-82c4-d5c40dd26a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:21.704951 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fe7af-77ec-4f29-82c4-d5c40dd26a9c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:21.709703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 456/912] 10.222.0.52 () {56 vars in 1116 bytes} [Sat Sep 17 20:41:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:21.715439 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424aa19-e1db-43a3-b0ca-ce1a6538c9c9 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:21.815811 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424aa19-e1db-43a3-b0ca-ce1a6538c9c9 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:21.852489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214b3c-1be6-4581-b596-2edc6e8b8692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:21.853076 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214b3c-1be6-4581-b596-2edc6e8b8692 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:21.853382 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214b3c-1be6-4581-b596-2edc6e8b8692 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:21.853653 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214b3c-1be6-4581-b596-2edc6e8b8692 None admin] PATH_INFO: `/v3/services` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:21.854267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214b3c-1be6-4581-b596-2edc6e8b8692 None admin] RBAC: Adding query filter params (type=placement) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:21.854566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214b3c-1be6-4581-b596-2edc6e8b8692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:21.856038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214b3c-1be6-4581-b596-2edc6e8b8692 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:21.860524 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 457/913] 10.222.0.52 () {56 vars in 1116 bytes} [Sat Sep 17 20:41:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:24.224695 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10f036-4365-4075-9759-c701238651dd None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:24.225257 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10f036-4365-4075-9759-c701238651dd None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:24.225347 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10f036-4365-4075-9759-c701238651dd None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:24.226634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 457/914] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:41:24.231893 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42f20-1628-4b7d-9564-857288276e4b None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:24.232337 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42f20-1628-4b7d-9564-857288276e4b None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:24.232430 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42f20-1628-4b7d-9564-857288276e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:24.251560 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-c0d42f20-1628-4b7d-9564-857288276e4b None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:41:24.252736 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-c0d42f20-1628-4b7d-9564-857288276e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:41:24.278727 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:24.319478 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 458/915] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:41:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:41:24.654288 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10f036-4365-4075-9759-c701238651dd None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:24.684975 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:24.753673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10f036-4365-4075-9759-c701238651dd None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:24.787130 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12419d2e-d7db-4f84-8e39-a713d84d3a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:24.787719 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12419d2e-d7db-4f84-8e39-a713d84d3a7a None admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:24.787996 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12419d2e-d7db-4f84-8e39-a713d84d3a7a None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:24.788267 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12419d2e-d7db-4f84-8e39-a713d84d3a7a None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:24.788915 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12419d2e-d7db-4f84-8e39-a713d84d3a7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:24.790327 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12419d2e-d7db-4f84-8e39-a713d84d3a7a None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:24.851806 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 458/916] 10.222.0.52 () {60 vars in 1141 bytes} [Sat Sep 17 20:41:24 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:41:27.249629 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c87c-adfc-4a1e-b38b-18b24a148100 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:27.250163 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c87c-adfc-4a1e-b38b-18b24a148100 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:27.250163 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c87c-adfc-4a1e-b38b-18b24a148100 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:27.252246 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 459/917] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:41:27.257398 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5160-1028-42cc-b9c6-adcde0b4a7d5 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:27.257805 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5160-1028-42cc-b9c6-adcde0b4a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:27.260094 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5160-1028-42cc-b9c6-adcde0b4a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:27.276525 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-bc3a5160-1028-42cc-b9c6-adcde0b4a7d5 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:41:27.277729 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-bc3a5160-1028-42cc-b9c6-adcde0b4a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:41:27.348314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 459/918] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:41:27 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:41:27.667746 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4c87c-adfc-4a1e-b38b-18b24a148100 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:27.770567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4c87c-adfc-4a1e-b38b-18b24a148100 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:27.802925 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79fd6d-f77f-439f-85a4-4d862bda39cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:27.803530 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79fd6d-f77f-439f-85a4-4d862bda39cd None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:27.803873 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79fd6d-f77f-439f-85a4-4d862bda39cd None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:27.804232 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79fd6d-f77f-439f-85a4-4d862bda39cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:27.804796 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79fd6d-f77f-439f-85a4-4d862bda39cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:27.806191 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79fd6d-f77f-439f-85a4-4d862bda39cd None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-ef79fd6d-f77f-439f-85a4-4d862bda39cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:27.815903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:27.817098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:27.818161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 460/919] 10.222.0.52 () {56 vars in 1117 bytes} [Sat Sep 17 20:41:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:27.822905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a5160-1028-42cc-b9c6-adcde0b4a7d5 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:27.841542 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:27.920999 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a5160-1028-42cc-b9c6-adcde0b4a7d5 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:27.955925 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618caf5-cac0-4111-9882-ec142ad2dafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:27.956560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618caf5-cac0-4111-9882-ec142ad2dafd None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:27.956841 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618caf5-cac0-4111-9882-ec142ad2dafd None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:27.957107 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618caf5-cac0-4111-9882-ec142ad2dafd None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:27.957765 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618caf5-cac0-4111-9882-ec142ad2dafd None admin] RBAC: Adding query filter params (name=placement) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:27.963004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618caf5-cac0-4111-9882-ec142ad2dafd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:27.963004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618caf5-cac0-4111-9882-ec142ad2dafd None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:27.964507 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 460/920] 10.222.0.52 () {56 vars in 1116 bytes} [Sat Sep 17 20:41:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:27.970536 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79fd6d-f77f-439f-85a4-4d862bda39cd None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:27.999055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:28.068763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79fd6d-f77f-439f-85a4-4d862bda39cd None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:28.101700 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df1a28-e233-48fa-be57-f4840642868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:28.102284 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df1a28-e233-48fa-be57-f4840642868d None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:28.102566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df1a28-e233-48fa-be57-f4840642868d None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:28.102830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df1a28-e233-48fa-be57-f4840642868d None admin] PATH_INFO: `/v3/endpoints` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:28.103516 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df1a28-e233-48fa-be57-f4840642868d None admin] RBAC: Adding query filter params (interface=public, service_id=22bb96d9469a42b0a9f74b8e737a3876, region_id=RegionOne) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:28.103824 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df1a28-e233-48fa-be57-f4840642868d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:28.105186 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df1a28-e233-48fa-be57-f4840642868d None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:28.110583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 461/921] 10.222.0.52 () {56 vars in 1251 bytes} [Sat Sep 17 20:41:27 2022] GET /identity/v3/endpoints?service_id=22bb96d9469a42b0a9f74b8e737a3876&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:41:28.116268 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618caf5-cac0-4111-9882-ec142ad2dafd None admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:28.196930 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:28.214362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618caf5-cac0-4111-9882-ec142ad2dafd None admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:28.247445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a3cf7-c1e6-4469-a4c4-4bdba928591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:28.248036 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a3cf7-c1e6-4469-a4c4-4bdba928591f None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:28.248314 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a3cf7-c1e6-4469-a4c4-4bdba928591f None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:28.248583 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a3cf7-c1e6-4469-a4c4-4bdba928591f None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:28.249195 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a3cf7-c1e6-4469-a4c4-4bdba928591f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:28.251215 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a3cf7-c1e6-4469-a4c4-4bdba928591f None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:28.257584 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 461/922] 10.222.0.52 () {56 vars in 1087 bytes} [Sat Sep 17 20:41:28 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:41:30.695266 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7240e-0b8c-41ee-b262-54dfebcd25ee None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:30.695852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7240e-0b8c-41ee-b262-54dfebcd25ee None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:30.695852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7240e-0b8c-41ee-b262-54dfebcd25ee None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:30.697211 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 462/923] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:41:30.702799 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800bb2-e031-428a-bd72-83c9d5d90f0a None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:30.703223 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800bb2-e031-428a-bd72-83c9d5d90f0a None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:30.703353 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800bb2-e031-428a-bd72-83c9d5d90f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:30.722581 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d0800bb2-e031-428a-bd72-83c9d5d90f0a None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:41:30.723752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d0800bb2-e031-428a-bd72-83c9d5d90f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:41:30.795216 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 462/924] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:41:30 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 20:41:31.118162 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7240e-0b8c-41ee-b262-54dfebcd25ee None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:31.211138 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:31.221757 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7240e-0b8c-41ee-b262-54dfebcd25ee None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:31.256864 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c3f6f-4191-4213-b6d4-0c42f7389749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:31.257498 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c3f6f-4191-4213-b6d4-0c42f7389749 None admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:31.257770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c3f6f-4191-4213-b6d4-0c42f7389749 None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:31.258038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c3f6f-4191-4213-b6d4-0c42f7389749 None admin] PATH_INFO: `/v3/services/placement` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:31.258608 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c3f6f-4191-4213-b6d4-0c42f7389749 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:31.259955 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c3f6f-4191-4213-b6d4-0c42f7389749 None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application [None req-a59c3f6f-4191-4213-b6d4-0c42f7389749 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 20:41:31.268390 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 20:41:31.269578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application with Lock( Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self._enter() Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application return self.creator() Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application created_value = creator( Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: ERROR keystone.server.flask.application Sep 17 20:41:31.270814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 463/925] 10.222.0.52 () {56 vars in 1117 bytes} [Sat Sep 17 20:41:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 20:41:31.275474 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800bb2-e031-428a-bd72-83c9d5d90f0a None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:31.349118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:31.371425 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800bb2-e031-428a-bd72-83c9d5d90f0a None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:31.405712 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2c420-44d0-4661-bdc9-35a41ffcf99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:31.406341 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2c420-44d0-4661-bdc9-35a41ffcf99c None admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:31.406617 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2c420-44d0-4661-bdc9-35a41ffcf99c None admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:31.406921 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2c420-44d0-4661-bdc9-35a41ffcf99c None admin] PATH_INFO: `/v3/services` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:31.407563 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2c420-44d0-4661-bdc9-35a41ffcf99c None admin] RBAC: Adding query filter params (name=placement) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:41:31.407863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2c420-44d0-4661-bdc9-35a41ffcf99c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:31.409494 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2c420-44d0-4661-bdc9-35a41ffcf99c None admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:31.414437 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 463/926] 10.222.0.52 () {56 vars in 1116 bytes} [Sat Sep 17 20:41:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:41:31.420270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c3f6f-4191-4213-b6d4-0c42f7389749 None admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:41:31.519120 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c3f6f-4191-4213-b6d4-0c42f7389749 None admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:41:31.553156 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ae3b-7b29-4a1a-b29a-999578ee714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:41:31.553766 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ae3b-7b29-4a1a-b29a-999578ee714c None admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:41:31.554042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ae3b-7b29-4a1a-b29a-999578ee714c None admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:41:31.554312 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ae3b-7b29-4a1a-b29a-999578ee714c None admin] PATH_INFO: `/v3/endpoints` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:41:31.554977 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ae3b-7b29-4a1a-b29a-999578ee714c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:41:31.556391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ae3b-7b29-4a1a-b29a-999578ee714c None admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:41:31.640286 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 464/927] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:41:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:41:41.411506 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=30 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:41.635898 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:47:27.774982 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423e98-a778-4f05-a825-753e50f9dbc5 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:27.775572 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423e98-a778-4f05-a825-753e50f9dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:27.775572 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423e98-a778-4f05-a825-753e50f9dbc5 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:27.776885 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 464/928] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:27.783804 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538fd3e-edcf-4da6-bde7-a42c5117d82e None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:27.784298 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538fd3e-edcf-4da6-bde7-a42c5117d82e None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:27.784394 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538fd3e-edcf-4da6-bde7-a42c5117d82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:27.888981 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-3538fd3e-edcf-4da6-bde7-a42c5117d82e None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:27.890789 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-3538fd3e-edcf-4da6-bde7-a42c5117d82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:28.033520 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 465/929] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:28.395269 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c14a2-ae88-40d1-9c91-a6b2b946632d None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:28.395706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c14a2-ae88-40d1-9c91-a6b2b946632d None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:28.396045 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c14a2-ae88-40d1-9c91-a6b2b946632d None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:28.397488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 465/930] 10.222.0.52 () {54 vars in 963 bytes} [Sat Sep 17 20:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:28.403807 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb9a0-0ce0-4f0f-b050-e02cc32d6a67 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:28.404035 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb9a0-0ce0-4f0f-b050-e02cc32d6a67 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:28.404311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb9a0-0ce0-4f0f-b050-e02cc32d6a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:28.474314 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-200cb9a0-0ce0-4f0f-b050-e02cc32d6a67 None None] MFA Rules not processed for user `ca8186a27e64434f92b8bba23558cf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:28.475562 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-200cb9a0-0ce0-4f0f-b050-e02cc32d6a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:28.520543 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:47:28.555302 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 466/931] 10.222.0.52 () {58 vars in 1060 bytes} [Sat Sep 17 20:47:28 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:28.564145 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c14a2-ae88-40d1-9c91-a6b2b946632d None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:28.574535 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c14a2-ae88-40d1-9c91-a6b2b946632d None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:28.577929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524a93f-981e-41c4-baf6-534b1a4f4dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:28.578510 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a93f-981e-41c4-baf6-534b1a4f4dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:28.578779 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a93f-981e-41c4-baf6-534b1a4f4dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:28.579042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a93f-981e-41c4-baf6-534b1a4f4dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:28.587779 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a93f-981e-41c4-baf6-534b1a4f4dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:28.589211 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a93f-981e-41c4-baf6-534b1a4f4dc9 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:28.599203 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 466/932] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:47:31.354447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f692f0-bc85-42cf-8998-710ad0e2d596 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:31.355217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f692f0-bc85-42cf-8998-710ad0e2d596 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:31.355217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f692f0-bc85-42cf-8998-710ad0e2d596 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:31.356538 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 467/933] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:31.362798 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607553ce-3c40-47aa-8e47-5c17a6d73dc8 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:31.363212 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607553ce-3c40-47aa-8e47-5c17a6d73dc8 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:31.367591 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607553ce-3c40-47aa-8e47-5c17a6d73dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:31.385597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-607553ce-3c40-47aa-8e47-5c17a6d73dc8 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:31.386801 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-607553ce-3c40-47aa-8e47-5c17a6d73dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:31.395789 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 467/934] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:31.741446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f692f0-bc85-42cf-8998-710ad0e2d596 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:31.756269 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f692f0-bc85-42cf-8998-710ad0e2d596 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:31.761045 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69f67b-dd5c-473b-9de9-2186be4e5c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:31.761686 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69f67b-dd5c-473b-9de9-2186be4e5c28 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:31.761965 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69f67b-dd5c-473b-9de9-2186be4e5c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:31.762238 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69f67b-dd5c-473b-9de9-2186be4e5c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:31.776817 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69f67b-dd5c-473b-9de9-2186be4e5c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:31.778289 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69f67b-dd5c-473b-9de9-2186be4e5c28 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:31.789501 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 468/935] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:47:34.839393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a31fe-f7a6-438d-9438-3cc101d4c6a3 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:34.839856 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a31fe-f7a6-438d-9438-3cc101d4c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:34.839948 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a31fe-f7a6-438d-9438-3cc101d4c6a3 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:34.841484 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 468/936] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:34.847033 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a72407-059d-4a88-b98e-0ec09ea93711 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:34.851669 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a72407-059d-4a88-b98e-0ec09ea93711 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:34.851669 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a72407-059d-4a88-b98e-0ec09ea93711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:34.912131 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-89a72407-059d-4a88-b98e-0ec09ea93711 None None] MFA Rules not processed for user `fdf274baf5444ff3b62a655abb478066`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:34.913359 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-89a72407-059d-4a88-b98e-0ec09ea93711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:34.996879 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 469/937] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:34 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:35.353659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7f4e-f13b-4f85-9241-57ff92cb0809 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:35.353933 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7f4e-f13b-4f85-9241-57ff92cb0809 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:35.354202 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7f4e-f13b-4f85-9241-57ff92cb0809 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:35.355601 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 469/938] 10.222.0.52 () {54 vars in 963 bytes} [Sat Sep 17 20:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:35.362540 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21718-4090-4207-b523-404e49474bff None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:35.362827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21718-4090-4207-b523-404e49474bff None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:35.363099 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21718-4090-4207-b523-404e49474bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:35.382185 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-1fc21718-4090-4207-b523-404e49474bff None None] MFA Rules not processed for user `ca8186a27e64434f92b8bba23558cf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:35.383372 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-1fc21718-4090-4207-b523-404e49474bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:35.389654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 470/939] 10.222.0.52 () {58 vars in 1060 bytes} [Sat Sep 17 20:47:35 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:35.399053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7f4e-f13b-4f85-9241-57ff92cb0809 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:35.410898 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7f4e-f13b-4f85-9241-57ff92cb0809 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:35.414284 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03107b-0d50-404f-9cef-a2aa8a06a697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:35.414860 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03107b-0d50-404f-9cef-a2aa8a06a697 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:35.415132 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03107b-0d50-404f-9cef-a2aa8a06a697 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:35.415395 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03107b-0d50-404f-9cef-a2aa8a06a697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:35.424920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03107b-0d50-404f-9cef-a2aa8a06a697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:35.426380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03107b-0d50-404f-9cef-a2aa8a06a697 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:35.435320 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 470/940] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:35 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:47:38.962620 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28d9d8-73ef-438b-b377-fd43fee00f38 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:38.963136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28d9d8-73ef-438b-b377-fd43fee00f38 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:38.963136 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28d9d8-73ef-438b-b377-fd43fee00f38 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:38.964752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 471/941] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:38.969643 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb39791-91ac-4c15-bb1a-1b58d99e4167 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:38.970027 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb39791-91ac-4c15-bb1a-1b58d99e4167 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:38.970191 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb39791-91ac-4c15-bb1a-1b58d99e4167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:38.990517 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-1bb39791-91ac-4c15-bb1a-1b58d99e4167 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:38.991703 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-1bb39791-91ac-4c15-bb1a-1b58d99e4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:39.061635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 471/942] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:38 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:39.399424 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28d9d8-73ef-438b-b377-fd43fee00f38 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:39.410496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28d9d8-73ef-438b-b377-fd43fee00f38 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:39.413990 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f84d02-e68e-4654-ba0e-b964da83e1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:39.414566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84d02-e68e-4654-ba0e-b964da83e1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:39.414839 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84d02-e68e-4654-ba0e-b964da83e1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:39.415105 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84d02-e68e-4654-ba0e-b964da83e1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:39.423585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f84d02-e68e-4654-ba0e-b964da83e1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:39.425060 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f84d02-e68e-4654-ba0e-b964da83e1e1 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:39.434045 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 472/943] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:39 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:47:42.865312 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd72b6d-b4f2-4508-a2e4-87ee23285f7b None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:42.865833 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd72b6d-b4f2-4508-a2e4-87ee23285f7b None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:42.865926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd72b6d-b4f2-4508-a2e4-87ee23285f7b None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:42.867196 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 472/944] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:42.872384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f79e-3eaa-4f54-a356-b5aaf189b4d3 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:42.872808 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f79e-3eaa-4f54-a356-b5aaf189b4d3 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:42.872939 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f79e-3eaa-4f54-a356-b5aaf189b4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:42.892333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-7994f79e-3eaa-4f54-a356-b5aaf189b4d3 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:42.894277 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-7994f79e-3eaa-4f54-a356-b5aaf189b4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:42.901979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 473/945] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:43.249634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd72b6d-b4f2-4508-a2e4-87ee23285f7b None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:43.260334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd72b6d-b4f2-4508-a2e4-87ee23285f7b None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:43.263686 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a6422-dd3d-40df-90b5-b756083e7261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:43.264277 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a6422-dd3d-40df-90b5-b756083e7261 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:43.264632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a6422-dd3d-40df-90b5-b756083e7261 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:43.264848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a6422-dd3d-40df-90b5-b756083e7261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:43.274466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a6422-dd3d-40df-90b5-b756083e7261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:43.275933 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a6422-dd3d-40df-90b5-b756083e7261 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:43.286248 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 473/946] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:47:45.818747 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ddcc6-b3f4-4e22-bb0c-2aa9a6c268cb None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:45.819215 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ddcc6-b3f4-4e22-bb0c-2aa9a6c268cb None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:45.819309 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ddcc6-b3f4-4e22-bb0c-2aa9a6c268cb None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:45.820738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 474/947] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:45.825945 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4cb51-c7c2-4988-9664-a3a25402b447 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:45.826369 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4cb51-c7c2-4988-9664-a3a25402b447 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:45.826485 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4cb51-c7c2-4988-9664-a3a25402b447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:45.846043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-fda4cb51-c7c2-4988-9664-a3a25402b447 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:45.847370 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-fda4cb51-c7c2-4988-9664-a3a25402b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:45.855071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 474/948] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:46.194549 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ddcc6-b3f4-4e22-bb0c-2aa9a6c268cb None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:46.205108 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ddcc6-b3f4-4e22-bb0c-2aa9a6c268cb None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:46.209226 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ce6a2-ee89-45aa-b5e3-0554c8e3cfc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:46.209813 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ce6a2-ee89-45aa-b5e3-0554c8e3cfc2 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:46.210216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ce6a2-ee89-45aa-b5e3-0554c8e3cfc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:46.210494 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ce6a2-ee89-45aa-b5e3-0554c8e3cfc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:46.219174 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ce6a2-ee89-45aa-b5e3-0554c8e3cfc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:46.220737 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ce6a2-ee89-45aa-b5e3-0554c8e3cfc2 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:46.230565 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 475/949] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:47:48.672955 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990feb5-66eb-459e-b4de-08c64b95c195 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:48.673599 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990feb5-66eb-459e-b4de-08c64b95c195 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:48.673599 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990feb5-66eb-459e-b4de-08c64b95c195 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:48.675032 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 475/950] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:48.680065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b530d-618c-4ced-8bc0-d49fcd53e9bd None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:48.680471 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b530d-618c-4ced-8bc0-d49fcd53e9bd None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:48.680611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b530d-618c-4ced-8bc0-d49fcd53e9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:48.700220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-0e5b530d-618c-4ced-8bc0-d49fcd53e9bd None None] MFA Rules not processed for user `fdf274baf5444ff3b62a655abb478066`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:48.701493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-0e5b530d-618c-4ced-8bc0-d49fcd53e9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:48.711436 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 476/951] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:48 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:49.044338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990feb5-66eb-459e-b4de-08c64b95c195 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:49.055329 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990feb5-66eb-459e-b4de-08c64b95c195 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:49.063059 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931a281-b858-4629-841b-8a1c4cd9c87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:49.063646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931a281-b858-4629-841b-8a1c4cd9c87d service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:49.063917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931a281-b858-4629-841b-8a1c4cd9c87d service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:49.064179 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931a281-b858-4629-841b-8a1c4cd9c87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:49.073999 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931a281-b858-4629-841b-8a1c4cd9c87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:49.075445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931a281-b858-4629-841b-8a1c4cd9c87d service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:49.085134 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 476/952] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:49 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:47:52.019808 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38163d-f7e9-4c23-9fc8-288f282bf215 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:52.020317 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38163d-f7e9-4c23-9fc8-288f282bf215 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:52.020317 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38163d-f7e9-4c23-9fc8-288f282bf215 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:52.021693 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 477/953] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:52.026819 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cd326-fb8d-4f40-b09e-36973934399f None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:52.027228 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cd326-fb8d-4f40-b09e-36973934399f None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:52.027334 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cd326-fb8d-4f40-b09e-36973934399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:52.035182 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=62 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:47:52.047812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-974cd326-fb8d-4f40-b09e-36973934399f None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:52.051318 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-974cd326-fb8d-4f40-b09e-36973934399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:52.072379 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 477/954] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:52.426258 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38163d-f7e9-4c23-9fc8-288f282bf215 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:52.436821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38163d-f7e9-4c23-9fc8-288f282bf215 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:52.440814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f867d4-cd59-4b91-845e-548a51323944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:52.441510 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f867d4-cd59-4b91-845e-548a51323944 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:52.441789 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f867d4-cd59-4b91-845e-548a51323944 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:52.442121 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f867d4-cd59-4b91-845e-548a51323944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:52.450971 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f867d4-cd59-4b91-845e-548a51323944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:52.452379 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f867d4-cd59-4b91-845e-548a51323944 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:52.462369 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 478/955] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:47:54.902572 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16255b-33f8-4c94-9cab-ee0a8c62120d None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:54.903097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16255b-33f8-4c94-9cab-ee0a8c62120d None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:54.903097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16255b-33f8-4c94-9cab-ee0a8c62120d None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:54.904453 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 478/956] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:54.909897 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b5bc9-39b9-43d9-84b1-5b507a74d6a6 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:54.910330 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b5bc9-39b9-43d9-84b1-5b507a74d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:54.910477 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b5bc9-39b9-43d9-84b1-5b507a74d6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:54.917738 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:47:54.929561 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-b04b5bc9-39b9-43d9-84b1-5b507a74d6a6 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:54.930757 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-b04b5bc9-39b9-43d9-84b1-5b507a74d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:54.938361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 479/957] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:55.305816 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16255b-33f8-4c94-9cab-ee0a8c62120d None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:55.316681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16255b-33f8-4c94-9cab-ee0a8c62120d None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:55.320184 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed6b8c-04b2-4815-b795-08d5db7ee0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:55.320770 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6b8c-04b2-4815-b795-08d5db7ee0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:55.321046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6b8c-04b2-4815-b795-08d5db7ee0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:55.321360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6b8c-04b2-4815-b795-08d5db7ee0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:55.330010 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed6b8c-04b2-4815-b795-08d5db7ee0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:55.331985 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed6b8c-04b2-4815-b795-08d5db7ee0f7 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:55.341180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 479/958] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:47:58.327758 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e083c0-fd5c-4347-acb2-34b8a660b08c None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:58.328305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e083c0-fd5c-4347-acb2-34b8a660b08c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:58.328400 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e083c0-fd5c-4347-acb2-34b8a660b08c None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:58.329733 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 480/959] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:47:58.335219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172038-520e-4653-9f2c-629908353049 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:58.339381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172038-520e-4653-9f2c-629908353049 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:58.339381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172038-520e-4653-9f2c-629908353049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:58.354623 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d6172038-520e-4653-9f2c-629908353049 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:47:58.355821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d6172038-520e-4653-9f2c-629908353049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:47:58.364480 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 480/960] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:47:58 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:47:58.709683 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e083c0-fd5c-4347-acb2-34b8a660b08c None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:47:58.720258 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e083c0-fd5c-4347-acb2-34b8a660b08c None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:47:58.724476 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36e1b-a543-4d6a-a6ec-c852fea41f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:47:58.725060 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36e1b-a543-4d6a-a6ec-c852fea41f78 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:47:58.725358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36e1b-a543-4d6a-a6ec-c852fea41f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:47:58.725628 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36e1b-a543-4d6a-a6ec-c852fea41f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:47:58.734703 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36e1b-a543-4d6a-a6ec-c852fea41f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:47:58.739877 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36e1b-a543-4d6a-a6ec-c852fea41f78 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:47:58.746537 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 481/961] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:47:58 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:03.402206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1624-dbf0-4ec6-a462-a0a8553141c9 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:03.402715 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1624-dbf0-4ec6-a462-a0a8553141c9 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:03.402809 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1624-dbf0-4ec6-a462-a0a8553141c9 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:03.404082 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 481/962] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:03.410218 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4f375-798d-42e8-b798-b4d75c28ef5a None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:03.410703 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4f375-798d-42e8-b798-b4d75c28ef5a None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:03.411146 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4f375-798d-42e8-b798-b4d75c28ef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:03.430818 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-a2b4f375-798d-42e8-b798-b4d75c28ef5a None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:03.431986 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-a2b4f375-798d-42e8-b798-b4d75c28ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:03.439542 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 482/963] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:03.783869 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1624-dbf0-4ec6-a462-a0a8553141c9 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:03.795102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1624-dbf0-4ec6-a462-a0a8553141c9 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:03.798959 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a95ad-134c-4a62-940e-8601116907df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:03.799553 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a95ad-134c-4a62-940e-8601116907df service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:03.799822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a95ad-134c-4a62-940e-8601116907df service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:03.800100 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a95ad-134c-4a62-940e-8601116907df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:03.811753 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a95ad-134c-4a62-940e-8601116907df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:03.811753 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a95ad-134c-4a62-940e-8601116907df service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:03.822138 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 482/964] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:07.262721 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837935-fdec-49a7-a392-4c01dab5a670 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:07.263237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837935-fdec-49a7-a392-4c01dab5a670 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:07.263237 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837935-fdec-49a7-a392-4c01dab5a670 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:07.264502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 483/965] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:07.269713 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b4e5-f79f-4fe2-9274-64ae7f6887d1 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:07.270231 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b4e5-f79f-4fe2-9274-64ae7f6887d1 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:07.270325 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b4e5-f79f-4fe2-9274-64ae7f6887d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:07.289738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-de90b4e5-f79f-4fe2-9274-64ae7f6887d1 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:07.290933 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-de90b4e5-f79f-4fe2-9274-64ae7f6887d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:07.298615 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 483/966] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:07 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:07.643484 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837935-fdec-49a7-a392-4c01dab5a670 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:07.654156 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837935-fdec-49a7-a392-4c01dab5a670 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:07.657726 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c466433-fb3c-47f6-b50a-2a5a9f54d25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:07.658309 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c466433-fb3c-47f6-b50a-2a5a9f54d25d service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:07.658602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c466433-fb3c-47f6-b50a-2a5a9f54d25d service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:07.658871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c466433-fb3c-47f6-b50a-2a5a9f54d25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:07.668409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c466433-fb3c-47f6-b50a-2a5a9f54d25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:07.669863 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c466433-fb3c-47f6-b50a-2a5a9f54d25d service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:07.679765 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 484/967] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:07 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:12.313123 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fddee1-5495-44e0-9c4d-bd27b8b617df None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:12.313689 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fddee1-5495-44e0-9c4d-bd27b8b617df None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:12.313689 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fddee1-5495-44e0-9c4d-bd27b8b617df None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:12.315183 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 484/968] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:12.320159 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ebf6-53d9-460b-b0e0-bc0a73e1767c None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:12.320567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ebf6-53d9-460b-b0e0-bc0a73e1767c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:12.320823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ebf6-53d9-460b-b0e0-bc0a73e1767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:12.340406 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-d945ebf6-53d9-460b-b0e0-bc0a73e1767c None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:12.341618 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-d945ebf6-53d9-460b-b0e0-bc0a73e1767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:12.350270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 485/969] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:12.681657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fddee1-5495-44e0-9c4d-bd27b8b617df None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:12.693069 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fddee1-5495-44e0-9c4d-bd27b8b617df None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:12.696529 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80612f1f-bf10-4e4e-a18a-df607ea9a47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:12.697116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612f1f-bf10-4e4e-a18a-df607ea9a47f service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:12.697472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612f1f-bf10-4e4e-a18a-df607ea9a47f service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:12.697742 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612f1f-bf10-4e4e-a18a-df607ea9a47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:12.706598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80612f1f-bf10-4e4e-a18a-df607ea9a47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:12.708811 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80612f1f-bf10-4e4e-a18a-df607ea9a47f service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:12.718393 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 485/970] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:18.209102 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2f71d-f982-4c3b-a555-c4458422c641 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:18.209989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2f71d-f982-4c3b-a555-c4458422c641 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:18.210284 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2f71d-f982-4c3b-a555-c4458422c641 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:18.211775 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 486/971] 10.222.0.52 () {54 vars in 921 bytes} [Sat Sep 17 20:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:18.218617 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a895a8-1288-4d41-96c3-d703313a7e83 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:18.219415 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a895a8-1288-4d41-96c3-d703313a7e83 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:18.219829 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a895a8-1288-4d41-96c3-d703313a7e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:18.267743 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-15a895a8-1288-4d41-96c3-d703313a7e83 None None] MFA Rules not processed for user `88caaed0c8c4438ea57d2f313fcf287a`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:18.269127 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-15a895a8-1288-4d41-96c3-d703313a7e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:18.382878 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 486/972] 10.222.0.52 () {58 vars in 1018 bytes} [Sat Sep 17 20:48:18 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:22.335418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=20 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:48:23.156982 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331af7f-8d92-4860-ae23-e9942c7adc94 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:23.157431 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331af7f-8d92-4860-ae23-e9942c7adc94 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:23.161112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331af7f-8d92-4860-ae23-e9942c7adc94 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:23.161112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 487/973] 10.222.0.52 () {54 vars in 921 bytes} [Sat Sep 17 20:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:23.164750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd36b8-b845-422e-886d-1f64dc112411 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:23.165259 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd36b8-b845-422e-886d-1f64dc112411 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:23.165545 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd36b8-b845-422e-886d-1f64dc112411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:23.173576 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=66 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:48:23.186857 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-b8cd36b8-b845-422e-886d-1f64dc112411 None None] MFA Rules not processed for user `88caaed0c8c4438ea57d2f313fcf287a`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:23.188195 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-b8cd36b8-b845-422e-886d-1f64dc112411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:23.197403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 487/974] 10.222.0.52 () {58 vars in 1018 bytes} [Sat Sep 17 20:48:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:24.586924 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9415f-0e44-46bf-a28e-6bbb3fcfff95 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:24.587477 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9415f-0e44-46bf-a28e-6bbb3fcfff95 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:24.587477 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9415f-0e44-46bf-a28e-6bbb3fcfff95 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:24.588776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 488/975] 10.222.0.52 () {54 vars in 921 bytes} [Sat Sep 17 20:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:24.593918 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d317ac-dd14-4e2b-a3ad-9b0812f64de9 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:24.594329 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d317ac-dd14-4e2b-a3ad-9b0812f64de9 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:24.594631 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d317ac-dd14-4e2b-a3ad-9b0812f64de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:24.615023 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-76d317ac-dd14-4e2b-a3ad-9b0812f64de9 None None] MFA Rules not processed for user `88caaed0c8c4438ea57d2f313fcf287a`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:24.616209 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-76d317ac-dd14-4e2b-a3ad-9b0812f64de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:24.624661 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 488/976] 10.222.0.52 () {58 vars in 1018 bytes} [Sat Sep 17 20:48:24 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:28.775670 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373685c8-04ec-4eb0-af27-2710c553a8dd None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:28.776233 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373685c8-04ec-4eb0-af27-2710c553a8dd None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:28.776233 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373685c8-04ec-4eb0-af27-2710c553a8dd None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:28.781410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 489/977] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:28.782849 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3b573-72b3-4347-8244-802ae8023f54 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:28.783303 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3b573-72b3-4347-8244-802ae8023f54 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:28.783580 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3b573-72b3-4347-8244-802ae8023f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:28.804750 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-e5e3b573-72b3-4347-8244-802ae8023f54 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:28.806124 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-e5e3b573-72b3-4347-8244-802ae8023f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:28.814480 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 489/978] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:29.170891 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ba26-6289-41f9-9891-d33f5b0f7ae8 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:29.171641 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ba26-6289-41f9-9891-d33f5b0f7ae8 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:29.172241 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ba26-6289-41f9-9891-d33f5b0f7ae8 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:29.180818 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 490/979] 10.222.0.52 () {54 vars in 965 bytes} [Sat Sep 17 20:48:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:29.190998 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a8c89-4087-444e-ae27-459126e14c59 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:29.191474 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a8c89-4087-444e-ae27-459126e14c59 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:29.191912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a8c89-4087-444e-ae27-459126e14c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:29.233884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-4d9a8c89-4087-444e-ae27-459126e14c59 None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:29.235359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-4d9a8c89-4087-444e-ae27-459126e14c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:29.314398 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 490/980] 10.222.0.52 () {58 vars in 1062 bytes} [Sat Sep 17 20:48:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:48:29.323347 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51ba26-6289-41f9-9891-d33f5b0f7ae8 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:29.350888 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51ba26-6289-41f9-9891-d33f5b0f7ae8 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:29.356788 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1843442-ebaf-48ee-9c03-1f5c65436227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:29.357457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1843442-ebaf-48ee-9c03-1f5c65436227 service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:29.357734 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1843442-ebaf-48ee-9c03-1f5c65436227 service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:29.358003 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1843442-ebaf-48ee-9c03-1f5c65436227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:29.367454 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1843442-ebaf-48ee-9c03-1f5c65436227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:29.369028 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1843442-ebaf-48ee-9c03-1f5c65436227 service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:29.382561 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 491/981] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:32.030891 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fe5d7-1061-424c-a0fb-b90f33452c7e None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:32.031403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fe5d7-1061-424c-a0fb-b90f33452c7e None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:32.031403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fe5d7-1061-424c-a0fb-b90f33452c7e None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:32.032839 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 491/982] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:32.038852 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c55d5-1428-4dc9-9164-8827301f3bd4 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:32.039283 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c55d5-1428-4dc9-9164-8827301f3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:32.039400 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c55d5-1428-4dc9-9164-8827301f3bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:32.059617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-520c55d5-1428-4dc9-9164-8827301f3bd4 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:32.060801 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-520c55d5-1428-4dc9-9164-8827301f3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:32.069474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 492/983] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:32.423562 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fe5d7-1061-424c-a0fb-b90f33452c7e None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:32.437837 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fe5d7-1061-424c-a0fb-b90f33452c7e None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:32.443102 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f16c-da47-4907-87da-e3ec9c77c4c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:32.443796 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f16c-da47-4907-87da-e3ec9c77c4c6 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:32.444077 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f16c-da47-4907-87da-e3ec9c77c4c6 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:32.444349 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f16c-da47-4907-87da-e3ec9c77c4c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:32.453018 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697f16c-da47-4907-87da-e3ec9c77c4c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:32.454654 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697f16c-da47-4907-87da-e3ec9c77c4c6 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:32.465110 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 492/984] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:35.375553 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaf698-5b19-4b7a-b98b-17367abf0d39 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:35.375553 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaf698-5b19-4b7a-b98b-17367abf0d39 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:35.376012 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaf698-5b19-4b7a-b98b-17367abf0d39 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:35.377079 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 493/985] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:35.383679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6bd50-243e-41d1-abec-57795310eab1 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:35.384117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6bd50-243e-41d1-abec-57795310eab1 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:35.384375 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6bd50-243e-41d1-abec-57795310eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:35.405960 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-1ed6bd50-243e-41d1-abec-57795310eab1 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:35.407522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-1ed6bd50-243e-41d1-abec-57795310eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:35.417222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 493/986] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:48:35.783518 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1e42a-c8ff-4488-8e4d-7fb0ef0ccb52 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:35.784147 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1e42a-c8ff-4488-8e4d-7fb0ef0ccb52 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:35.784484 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1e42a-c8ff-4488-8e4d-7fb0ef0ccb52 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:35.785929 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 494/987] 10.222.0.52 () {54 vars in 965 bytes} [Sat Sep 17 20:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:35.794669 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba54b-6537-4e0d-a543-628f6adfd75e None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:35.794953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba54b-6537-4e0d-a543-628f6adfd75e None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:35.796122 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba54b-6537-4e0d-a543-628f6adfd75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:35.824817 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-6e5ba54b-6537-4e0d-a543-628f6adfd75e None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:35.826045 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-6e5ba54b-6537-4e0d-a543-628f6adfd75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:35.836141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 494/988] 10.222.0.52 () {58 vars in 1062 bytes} [Sat Sep 17 20:48:35 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:35.845911 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1e42a-c8ff-4488-8e4d-7fb0ef0ccb52 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:35.864873 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1e42a-c8ff-4488-8e4d-7fb0ef0ccb52 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:35.871835 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe2c7-2acd-4bca-b484-4688024a3510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:35.872459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe2c7-2acd-4bca-b484-4688024a3510 service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:35.872757 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe2c7-2acd-4bca-b484-4688024a3510 service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:35.873009 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe2c7-2acd-4bca-b484-4688024a3510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:35.882188 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe2c7-2acd-4bca-b484-4688024a3510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:35.883698 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe2c7-2acd-4bca-b484-4688024a3510 service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:35.903160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 495/989] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:38.540025 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06768-f82b-4a7c-9949-f5107f4da0eb None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:38.541034 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06768-f82b-4a7c-9949-f5107f4da0eb None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:38.541567 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06768-f82b-4a7c-9949-f5107f4da0eb None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:38.543122 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 495/990] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:48:38.548585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede2f48-7b34-4882-9a40-3a3bbd0a6a15 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:38.549411 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede2f48-7b34-4882-9a40-3a3bbd0a6a15 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:38.549900 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede2f48-7b34-4882-9a40-3a3bbd0a6a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:38.570233 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-7ede2f48-7b34-4882-9a40-3a3bbd0a6a15 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:38.571742 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-7ede2f48-7b34-4882-9a40-3a3bbd0a6a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:38.580009 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 496/991] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:38.980286 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb06768-f82b-4a7c-9949-f5107f4da0eb None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:38.999165 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb06768-f82b-4a7c-9949-f5107f4da0eb None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:39.016830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd08c1-74cb-46d3-aa3b-a4bd2a5aabb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:39.016830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd08c1-74cb-46d3-aa3b-a4bd2a5aabb6 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:39.016830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd08c1-74cb-46d3-aa3b-a4bd2a5aabb6 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:39.016830 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd08c1-74cb-46d3-aa3b-a4bd2a5aabb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:39.029076 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd08c1-74cb-46d3-aa3b-a4bd2a5aabb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:39.031295 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd08c1-74cb-46d3-aa3b-a4bd2a5aabb6 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:39.058602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 496/992] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:39.243418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e12e-a83c-4747-a014-c0a77e54c916 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:39.244016 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e12e-a83c-4747-a014-c0a77e54c916 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:39.244354 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e12e-a83c-4747-a014-c0a77e54c916 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:39.246105 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 497/993] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:39.251947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e81989-d995-478d-9e74-91d8be405b99 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:39.252416 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e81989-d995-478d-9e74-91d8be405b99 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:39.252796 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e81989-d995-478d-9e74-91d8be405b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:39.276624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-81e81989-d995-478d-9e74-91d8be405b99 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:39.278210 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-81e81989-d995-478d-9e74-91d8be405b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:39.286555 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 497/994] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:39.690541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d452-09dd-452e-a4c3-e753f0178435 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:39.690541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d452-09dd-452e-a4c3-e753f0178435 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:39.690541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d452-09dd-452e-a4c3-e753f0178435 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:39.694097 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 498/995] 10.222.0.52 () {54 vars in 964 bytes} [Sat Sep 17 20:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:39.697802 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa4c92-5a2e-42d3-b057-f1029389fbdb None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:39.698412 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa4c92-5a2e-42d3-b057-f1029389fbdb None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:39.698412 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa4c92-5a2e-42d3-b057-f1029389fbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:39.743510 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-12fa4c92-5a2e-42d3-b057-f1029389fbdb None None] MFA Rules not processed for user `681cab6042a3486087c55058843deeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:39.744873 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-12fa4c92-5a2e-42d3-b057-f1029389fbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:39.801633 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=100 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:48:39.811256 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 498/996] 10.222.0.52 () {58 vars in 1061 bytes} [Sat Sep 17 20:48:39 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:39.824161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172d452-09dd-452e-a4c3-e753f0178435 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:39.835648 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172d452-09dd-452e-a4c3-e753f0178435 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:39.839276 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d24085-9797-48c9-99ee-69281176f80d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681cab6042a3486087c55058843deeb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:39.839928 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24085-9797-48c9-99ee-69281176f80d service cinder] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:39.840190 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24085-9797-48c9-99ee-69281176f80d service cinder] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:39.840594 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24085-9797-48c9-99ee-69281176f80d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:39.850673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d24085-9797-48c9-99ee-69281176f80d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:39.852085 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d24085-9797-48c9-99ee-69281176f80d service cinder] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:39.861681 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 499/997] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:41.720028 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12525064-a0b9-4d06-ae8b-7c46491c2375 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:41.720613 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12525064-a0b9-4d06-ae8b-7c46491c2375 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:41.720613 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12525064-a0b9-4d06-ae8b-7c46491c2375 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:41.721978 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 499/998] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:41.728199 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7380499-d227-41c5-9af0-702e9d980ee7 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:41.728709 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7380499-d227-41c5-9af0-702e9d980ee7 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:41.728803 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7380499-d227-41c5-9af0-702e9d980ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:41.749047 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-a7380499-d227-41c5-9af0-702e9d980ee7 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:41.750280 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-a7380499-d227-41c5-9af0-702e9d980ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:41.759296 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 500/999] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:42.103454 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12525064-a0b9-4d06-ae8b-7c46491c2375 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:42.118014 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12525064-a0b9-4d06-ae8b-7c46491c2375 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:42.122972 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca160c1b-d165-4fb9-bdc1-c86f14420820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:42.123564 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160c1b-d165-4fb9-bdc1-c86f14420820 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:42.123836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160c1b-d165-4fb9-bdc1-c86f14420820 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:42.124101 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160c1b-d165-4fb9-bdc1-c86f14420820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:42.132302 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160c1b-d165-4fb9-bdc1-c86f14420820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:42.133918 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160c1b-d165-4fb9-bdc1-c86f14420820 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:42.143560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 500/1000] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:44.748773 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4627a-ad59-49c4-8a17-4c4ac0c90280 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:44.749376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4627a-ad59-49c4-8a17-4c4ac0c90280 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:44.749376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4627a-ad59-49c4-8a17-4c4ac0c90280 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:44.750674 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 501/1001] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:44.756112 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9804dc-6047-4ac1-9fdd-a19c64052e53 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:44.756758 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9804dc-6047-4ac1-9fdd-a19c64052e53 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:44.756758 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9804dc-6047-4ac1-9fdd-a19c64052e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:44.776316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-7e9804dc-6047-4ac1-9fdd-a19c64052e53 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:44.777536 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-7e9804dc-6047-4ac1-9fdd-a19c64052e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:44.785444 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 501/1002] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:45.140244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4627a-ad59-49c4-8a17-4c4ac0c90280 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:45.155749 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4627a-ad59-49c4-8a17-4c4ac0c90280 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:45.160713 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd91710-14df-4d6b-a846-70c1f25a1987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:45.161344 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd91710-14df-4d6b-a846-70c1f25a1987 service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:45.170274 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd91710-14df-4d6b-a846-70c1f25a1987 service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:45.170274 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd91710-14df-4d6b-a846-70c1f25a1987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:45.171341 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd91710-14df-4d6b-a846-70c1f25a1987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:45.173047 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd91710-14df-4d6b-a846-70c1f25a1987 service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:45.183781 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 502/1003] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:47.781955 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9735b6-b666-459a-a6b1-b89cf3348d97 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:47.782522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9735b6-b666-459a-a6b1-b89cf3348d97 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:47.782522 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9735b6-b666-459a-a6b1-b89cf3348d97 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:47.783811 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 502/1004] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:47.789705 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627de8-eac7-4240-8458-2da8c805d2dc None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:47.790112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627de8-eac7-4240-8458-2da8c805d2dc None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:47.790245 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627de8-eac7-4240-8458-2da8c805d2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:47.810225 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-30627de8-eac7-4240-8458-2da8c805d2dc None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:47.811791 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-30627de8-eac7-4240-8458-2da8c805d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:47.821437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 503/1005] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:48:48.171137 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9735b6-b666-459a-a6b1-b89cf3348d97 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:48.186681 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9735b6-b666-459a-a6b1-b89cf3348d97 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:48.191550 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1246ee6-006e-42c6-a660-ad4dcb04d03b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:48.192141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1246ee6-006e-42c6-a660-ad4dcb04d03b service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:48.192424 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1246ee6-006e-42c6-a660-ad4dcb04d03b service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:48.192724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1246ee6-006e-42c6-a660-ad4dcb04d03b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:48.202063 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1246ee6-006e-42c6-a660-ad4dcb04d03b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:48.203722 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1246ee6-006e-42c6-a660-ad4dcb04d03b service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:48.214190 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 503/1006] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:51.180594 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7249e4-ed3d-4a21-b4e1-53b6b0c6a76d None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:51.181481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7249e4-ed3d-4a21-b4e1-53b6b0c6a76d None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:51.181481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7249e4-ed3d-4a21-b4e1-53b6b0c6a76d None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:51.182455 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 504/1007] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:51.187733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253863a9-6eef-44c2-8b1a-6be17f147bac None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:51.188233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253863a9-6eef-44c2-8b1a-6be17f147bac None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:51.188345 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253863a9-6eef-44c2-8b1a-6be17f147bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:51.210383 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-253863a9-6eef-44c2-8b1a-6be17f147bac None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:51.211648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-253863a9-6eef-44c2-8b1a-6be17f147bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:51.219897 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 504/1008] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:51.562655 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7249e4-ed3d-4a21-b4e1-53b6b0c6a76d None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:51.583758 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7249e4-ed3d-4a21-b4e1-53b6b0c6a76d None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:51.589893 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f5c4b-f210-4656-9e67-e7cbaec00741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:51.590503 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5c4b-f210-4656-9e67-e7cbaec00741 service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:51.590837 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5c4b-f210-4656-9e67-e7cbaec00741 service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:51.591099 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5c4b-f210-4656-9e67-e7cbaec00741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:51.601324 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f5c4b-f210-4656-9e67-e7cbaec00741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:51.602558 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f5c4b-f210-4656-9e67-e7cbaec00741 service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:51.612215 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 505/1009] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:55.193950 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb7c73-9b22-4408-838f-abff70f236d3 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:55.194598 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb7c73-9b22-4408-838f-abff70f236d3 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:55.194820 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb7c73-9b22-4408-838f-abff70f236d3 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:55.196181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 505/1010] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:55.201629 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d823c3a-2ca3-4967-8d60-97511f321349 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:55.202129 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d823c3a-2ca3-4967-8d60-97511f321349 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:55.202233 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d823c3a-2ca3-4967-8d60-97511f321349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:55.210248 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=43 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:48:55.223160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-6d823c3a-2ca3-4967-8d60-97511f321349 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:55.224352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-6d823c3a-2ca3-4967-8d60-97511f321349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:55.232832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 506/1011] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:55.584502 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb7c73-9b22-4408-838f-abff70f236d3 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:55.598365 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb7c73-9b22-4408-838f-abff70f236d3 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:55.603833 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059ffb2-dcdd-407a-ba72-08ec6699f49e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:55.604428 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059ffb2-dcdd-407a-ba72-08ec6699f49e service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:55.604706 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059ffb2-dcdd-407a-ba72-08ec6699f49e service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:55.604978 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059ffb2-dcdd-407a-ba72-08ec6699f49e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:55.613179 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059ffb2-dcdd-407a-ba72-08ec6699f49e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:55.614778 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059ffb2-dcdd-407a-ba72-08ec6699f49e service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:55.625394 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 506/1012] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:48:56.911988 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e003fb-9fd0-4cf6-ab1d-b87f24e71802 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:56.912572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e003fb-9fd0-4cf6-ab1d-b87f24e71802 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:56.912572 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e003fb-9fd0-4cf6-ab1d-b87f24e71802 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:56.914473 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 507/1013] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:56.919672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5c00-166c-4716-a8f7-3b9fbc17e7f6 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:56.920155 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5c00-166c-4716-a8f7-3b9fbc17e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:56.920254 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5c00-166c-4716-a8f7-3b9fbc17e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:56.940312 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-a1cc5c00-166c-4716-a8f7-3b9fbc17e7f6 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:56.941617 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-a1cc5c00-166c-4716-a8f7-3b9fbc17e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:56.954083 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 507/1014] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:57.320493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b735027-20ea-43ef-ba8c-dbb31cc94321 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:57.320822 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b735027-20ea-43ef-ba8c-dbb31cc94321 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:57.321267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b735027-20ea-43ef-ba8c-dbb31cc94321 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:57.322820 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 508/1015] 10.222.0.52 () {54 vars in 962 bytes} [Sat Sep 17 20:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:48:57.328088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c55e-b0a6-4e1a-8c36-a1adf4b42104 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:57.328374 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c55e-b0a6-4e1a-8c36-a1adf4b42104 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:57.328648 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c55e-b0a6-4e1a-8c36-a1adf4b42104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:57.378105 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-3504c55e-b0a6-4e1a-8c36-a1adf4b42104 None None] MFA Rules not processed for user `d8200d2f30fa47dc9799dfa26a81109a`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:57.379311 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-3504c55e-b0a6-4e1a-8c36-a1adf4b42104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:57.437609 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 508/1016] 10.222.0.52 () {58 vars in 1059 bytes} [Sat Sep 17 20:48:57 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:48:57.446169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b735027-20ea-43ef-ba8c-dbb31cc94321 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:57.456714 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b735027-20ea-43ef-ba8c-dbb31cc94321 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:57.460456 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868ab4d-b809-4a09-91e7-a534b0dce501 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8200d2f30fa47dc9799dfa26a81109a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:57.461045 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868ab4d-b809-4a09-91e7-a534b0dce501 service glance] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:57.461362 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868ab4d-b809-4a09-91e7-a534b0dce501 service glance] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:57.461635 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868ab4d-b809-4a09-91e7-a534b0dce501 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:57.470503 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868ab4d-b809-4a09-91e7-a534b0dce501 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:57.472056 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868ab4d-b809-4a09-91e7-a534b0dce501 service glance] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:57.482025 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 509/1017] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 20:48:58.196521 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b275d6a-a474-4863-9662-dcee33d23d94 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:58.197107 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b275d6a-a474-4863-9662-dcee33d23d94 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:58.197107 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b275d6a-a474-4863-9662-dcee33d23d94 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:58.198471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 509/1018] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:48:58.203783 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb100f0c-22fe-495f-97a9-95857bc05845 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:58.204227 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb100f0c-22fe-495f-97a9-95857bc05845 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:58.204333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb100f0c-22fe-495f-97a9-95857bc05845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:58.223568 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-cb100f0c-22fe-495f-97a9-95857bc05845 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:48:58.224753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-cb100f0c-22fe-495f-97a9-95857bc05845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:48:58.232984 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 510/1019] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:48:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:48:58.591120 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b275d6a-a474-4863-9662-dcee33d23d94 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:48:58.605473 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b275d6a-a474-4863-9662-dcee33d23d94 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:48:58.610335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375ee9b-e420-474b-8602-e58b4626fa9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:48:58.610927 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ee9b-e420-474b-8602-e58b4626fa9b service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:48:58.611205 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ee9b-e420-474b-8602-e58b4626fa9b service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:48:58.611472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ee9b-e420-474b-8602-e58b4626fa9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:48:58.620945 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375ee9b-e420-474b-8602-e58b4626fa9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:48:58.623364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375ee9b-e420-474b-8602-e58b4626fa9b service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:48:58.635024 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 510/1020] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:48:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:01.363858 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8e87-e5d6-492e-bc06-552ebb2fad96 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:01.364502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8e87-e5d6-492e-bc06-552ebb2fad96 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:01.364502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8e87-e5d6-492e-bc06-552ebb2fad96 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:01.367436 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 511/1021] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:01.372280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ea6a-36a4-4873-b932-075319ba39fb None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:01.372758 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ea6a-36a4-4873-b932-075319ba39fb None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:01.372864 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ea6a-36a4-4873-b932-075319ba39fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:01.393748 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-2426ea6a-36a4-4873-b932-075319ba39fb None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:01.395012 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-2426ea6a-36a4-4873-b932-075319ba39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:01.403330 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 511/1022] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:49:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:01.747266 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8e87-e5d6-492e-bc06-552ebb2fad96 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:01.773690 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8e87-e5d6-492e-bc06-552ebb2fad96 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:01.778498 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3413b-b796-46c2-93dc-d295ae3ceada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:01.779090 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3413b-b796-46c2-93dc-d295ae3ceada service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:01.779363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3413b-b796-46c2-93dc-d295ae3ceada service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:01.779635 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3413b-b796-46c2-93dc-d295ae3ceada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:01.789112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3413b-b796-46c2-93dc-d295ae3ceada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:01.790716 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3413b-b796-46c2-93dc-d295ae3ceada service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:01.800212 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 512/1023] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:04.495524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5176b6-72e6-4222-9333-88f7a02d41f9 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:04.496130 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5176b6-72e6-4222-9333-88f7a02d41f9 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:04.496130 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5176b6-72e6-4222-9333-88f7a02d41f9 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:04.497426 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 512/1024] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:04.502637 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7351907-b2a7-4e59-b536-9cfadb31955d None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:04.503118 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7351907-b2a7-4e59-b536-9cfadb31955d None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:04.503231 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7351907-b2a7-4e59-b536-9cfadb31955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:04.529376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-f7351907-b2a7-4e59-b536-9cfadb31955d None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:04.537313 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-f7351907-b2a7-4e59-b536-9cfadb31955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:04.546529 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 513/1025] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:49:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:04.916844 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5176b6-72e6-4222-9333-88f7a02d41f9 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:04.935175 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5176b6-72e6-4222-9333-88f7a02d41f9 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:04.937816 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d252c7-acee-4d8c-87f1-62bdc964d23d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:04.938423 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d252c7-acee-4d8c-87f1-62bdc964d23d service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:04.938694 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d252c7-acee-4d8c-87f1-62bdc964d23d service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:04.938959 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d252c7-acee-4d8c-87f1-62bdc964d23d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:04.948751 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d252c7-acee-4d8c-87f1-62bdc964d23d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:04.950399 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d252c7-acee-4d8c-87f1-62bdc964d23d service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:04.962445 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 513/1026] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:13.908168 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f52023-de00-4896-bb5e-5bdd85409cf2 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:13.908789 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f52023-de00-4896-bb5e-5bdd85409cf2 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:13.908789 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f52023-de00-4896-bb5e-5bdd85409cf2 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:13.910064 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 514/1027] 10.222.0.52 () {54 vars in 918 bytes} [Sat Sep 17 20:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:13.915068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa80335-2279-4d28-9cec-d21adca19167 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:13.915514 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa80335-2279-4d28-9cec-d21adca19167 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:13.915609 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa80335-2279-4d28-9cec-d21adca19167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:13.923136 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=82 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:49:13.935440 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-5aa80335-2279-4d28-9cec-d21adca19167 None None] MFA Rules not processed for user `88caaed0c8c4438ea57d2f313fcf287a`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:13.936659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-5aa80335-2279-4d28-9cec-d21adca19167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:13.944978 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 514/1028] 10.222.0.52 () {58 vars in 1015 bytes} [Sat Sep 17 20:49:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:13.960198 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456d88-4ff8-44cd-9e35-35259418c0ca None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:13.960481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456d88-4ff8-44cd-9e35-35259418c0ca None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:13.960756 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456d88-4ff8-44cd-9e35-35259418c0ca None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:13.962440 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 515/1029] 10.222.0.52 () {54 vars in 918 bytes} [Sat Sep 17 20:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:13.967030 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16a664-783f-4643-86d8-e7b5402dd82c None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:13.967310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16a664-783f-4643-86d8-e7b5402dd82c None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:13.967577 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16a664-783f-4643-86d8-e7b5402dd82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:13.998701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-1c16a664-783f-4643-86d8-e7b5402dd82c None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:13.999895 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-1c16a664-783f-4643-86d8-e7b5402dd82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:14.008917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 515/1030] 10.222.0.52 () {58 vars in 1015 bytes} [Sat Sep 17 20:49:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:14.522574 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=20 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:49:16.817707 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93e74f-b57a-49ff-9349-1e5600bea823 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:16.818290 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93e74f-b57a-49ff-9349-1e5600bea823 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:16.818290 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93e74f-b57a-49ff-9349-1e5600bea823 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:16.819586 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 516/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:16.824946 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab35706-5c22-4f7e-8459-f02f812c9cfa None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:16.825396 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab35706-5c22-4f7e-8459-f02f812c9cfa None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:16.825533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab35706-5c22-4f7e-8459-f02f812c9cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:16.844962 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-5ab35706-5c22-4f7e-8459-f02f812c9cfa None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:16.846185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-5ab35706-5c22-4f7e-8459-f02f812c9cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:16.854303 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 516/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:17.192386 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93e74f-b57a-49ff-9349-1e5600bea823 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:17.205802 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93e74f-b57a-49ff-9349-1e5600bea823 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:17.210751 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7e7e6-ee39-4f6c-bc5b-054dcf9e89ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:17.211363 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e7e6-ee39-4f6c-bc5b-054dcf9e89ab service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:17.211632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e7e6-ee39-4f6c-bc5b-054dcf9e89ab service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:17.211905 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e7e6-ee39-4f6c-bc5b-054dcf9e89ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:17.220010 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7e7e6-ee39-4f6c-bc5b-054dcf9e89ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:17.221614 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7e7e6-ee39-4f6c-bc5b-054dcf9e89ab service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:17.231326 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 517/1033] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:18.972438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d0989-9853-4c3f-98bd-11f0dd1c0876 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:18.972973 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d0989-9853-4c3f-98bd-11f0dd1c0876 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:18.973095 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d0989-9853-4c3f-98bd-11f0dd1c0876 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:18.974432 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 517/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:18.979298 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a43a14-5f94-4c2a-840c-d5f717e37493 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:18.979701 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a43a14-5f94-4c2a-840c-d5f717e37493 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:18.979840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a43a14-5f94-4c2a-840c-d5f717e37493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:18.999029 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-29a43a14-5f94-4c2a-840c-d5f717e37493 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:19.000218 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-29a43a14-5f94-4c2a-840c-d5f717e37493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:19.008617 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 518/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:49:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:19.206964 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d0989-9853-4c3f-98bd-11f0dd1c0876 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:19.220488 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d0989-9853-4c3f-98bd-11f0dd1c0876 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:19.225363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662b97c-a4a2-44e7-b5cd-7db6ea6edcb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:19.225945 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662b97c-a4a2-44e7-b5cd-7db6ea6edcb5 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:19.226222 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662b97c-a4a2-44e7-b5cd-7db6ea6edcb5 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:19.226491 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662b97c-a4a2-44e7-b5cd-7db6ea6edcb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:19.234611 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662b97c-a4a2-44e7-b5cd-7db6ea6edcb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:19.236180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662b97c-a4a2-44e7-b5cd-7db6ea6edcb5 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:19.246450 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 518/1036] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:20.944422 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ebb1-3447-48b0-b9fa-5bbe0769e854 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:20.944950 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ebb1-3447-48b0-b9fa-5bbe0769e854 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:20.944950 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ebb1-3447-48b0-b9fa-5bbe0769e854 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:20.946859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 519/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:20.951723 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c76e27-aaa0-4d7a-a3d3-8f64db174fbc None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:20.952133 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c76e27-aaa0-4d7a-a3d3-8f64db174fbc None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:20.952288 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c76e27-aaa0-4d7a-a3d3-8f64db174fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:20.971912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-c3c76e27-aaa0-4d7a-a3d3-8f64db174fbc None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:20.973128 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-c3c76e27-aaa0-4d7a-a3d3-8f64db174fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:20.981021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 519/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:49:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:21.148633 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ebb1-3447-48b0-b9fa-5bbe0769e854 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:21.162229 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ebb1-3447-48b0-b9fa-5bbe0769e854 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:21.168941 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaf57f-ec69-43c8-8a1a-f9fbc0044b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:21.179255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaf57f-ec69-43c8-8a1a-f9fbc0044b1f service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:21.179255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaf57f-ec69-43c8-8a1a-f9fbc0044b1f service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:21.179255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaf57f-ec69-43c8-8a1a-f9fbc0044b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:21.179255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaf57f-ec69-43c8-8a1a-f9fbc0044b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:21.179836 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaf57f-ec69-43c8-8a1a-f9fbc0044b1f service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:21.190049 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 520/1039] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:22.844776 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d028bd-9778-4193-af5d-dfc17c9952ca None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:22.845312 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d028bd-9778-4193-af5d-dfc17c9952ca None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:22.845411 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d028bd-9778-4193-af5d-dfc17c9952ca None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:22.846670 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 520/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:22.851489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e77f0-eb77-499c-b08e-7f14fbc10aa0 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:22.851894 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e77f0-eb77-499c-b08e-7f14fbc10aa0 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:22.852056 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e77f0-eb77-499c-b08e-7f14fbc10aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:22.871615 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-5f6e77f0-eb77-499c-b08e-7f14fbc10aa0 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:22.872786 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-5f6e77f0-eb77-499c-b08e-7f14fbc10aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:22.880345 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 521/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:49:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:23.036113 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d028bd-9778-4193-af5d-dfc17c9952ca None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:23.056216 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d028bd-9778-4193-af5d-dfc17c9952ca None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:23.061116 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbe7de-b8be-44b7-880a-bd2713bedc2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:23.061734 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbe7de-b8be-44b7-880a-bd2713bedc2f service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:23.062078 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbe7de-b8be-44b7-880a-bd2713bedc2f service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:23.062276 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbe7de-b8be-44b7-880a-bd2713bedc2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:23.071949 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbe7de-b8be-44b7-880a-bd2713bedc2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:23.073835 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbe7de-b8be-44b7-880a-bd2713bedc2f service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:23.083351 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 521/1042] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:24.755854 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b1c0-cc2c-484c-97a3-ae4b27dbe84d None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:24.756428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b1c0-cc2c-484c-97a3-ae4b27dbe84d None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:24.756428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b1c0-cc2c-484c-97a3-ae4b27dbe84d None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:24.757794 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 522/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:24.763691 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9d5c2-8486-4d7c-9c25-6837496bfc31 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:24.764123 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9d5c2-8486-4d7c-9c25-6837496bfc31 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:24.764235 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9d5c2-8486-4d7c-9c25-6837496bfc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:24.784657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d2c9d5c2-8486-4d7c-9c25-6837496bfc31 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:24.785881 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d2c9d5c2-8486-4d7c-9c25-6837496bfc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:24.793971 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 522/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:49:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:24.952921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b1c0-cc2c-484c-97a3-ae4b27dbe84d None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:24.966666 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b1c0-cc2c-484c-97a3-ae4b27dbe84d None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:24.971804 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306c336-b57b-4b92-a8d2-c7ab856be59d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:24.972391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306c336-b57b-4b92-a8d2-c7ab856be59d service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:24.972670 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306c336-b57b-4b92-a8d2-c7ab856be59d service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:24.972949 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306c336-b57b-4b92-a8d2-c7ab856be59d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:24.981466 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306c336-b57b-4b92-a8d2-c7ab856be59d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:24.983060 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306c336-b57b-4b92-a8d2-c7ab856be59d service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:24.992092 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 523/1045] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:26.656903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f8d6-027c-4419-b294-f6ba34b6fc00 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:26.657525 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f8d6-027c-4419-b294-f6ba34b6fc00 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:26.657525 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f8d6-027c-4419-b294-f6ba34b6fc00 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:26.658834 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 523/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:26.663726 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784e9e2-159a-4899-96ba-857c3a16a576 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:26.664131 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784e9e2-159a-4899-96ba-857c3a16a576 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:26.664268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784e9e2-159a-4899-96ba-857c3a16a576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:26.684351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-6784e9e2-159a-4899-96ba-857c3a16a576 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:26.685580 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-6784e9e2-159a-4899-96ba-857c3a16a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:26.693235 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 524/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:26.857995 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629f8d6-027c-4419-b294-f6ba34b6fc00 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:26.871500 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629f8d6-027c-4419-b294-f6ba34b6fc00 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:26.876490 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528305aa-0eb1-4392-ac3e-8369412ed812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:26.877071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528305aa-0eb1-4392-ac3e-8369412ed812 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:26.877376 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528305aa-0eb1-4392-ac3e-8369412ed812 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:26.877646 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528305aa-0eb1-4392-ac3e-8369412ed812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:26.885701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528305aa-0eb1-4392-ac3e-8369412ed812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:26.887269 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528305aa-0eb1-4392-ac3e-8369412ed812 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:26.896296 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 524/1048] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:28.624521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16156-9e9c-49d9-8bea-d5999d6fe368 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:28.625083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16156-9e9c-49d9-8bea-d5999d6fe368 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:28.625083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16156-9e9c-49d9-8bea-d5999d6fe368 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:28.626404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 525/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:28.631364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cfb00-21e6-4d08-8674-08ecbf25d42b None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:28.631776 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cfb00-21e6-4d08-8674-08ecbf25d42b None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:28.637039 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cfb00-21e6-4d08-8674-08ecbf25d42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:28.651316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-9b5cfb00-21e6-4d08-8674-08ecbf25d42b None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:28.652543 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-9b5cfb00-21e6-4d08-8674-08ecbf25d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:28.660324 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 525/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:49:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:28.824523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d16156-9e9c-49d9-8bea-d5999d6fe368 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:28.838515 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d16156-9e9c-49d9-8bea-d5999d6fe368 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:28.843420 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc549b4-97f3-48a1-a43e-96c19c5bfa25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:28.844001 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc549b4-97f3-48a1-a43e-96c19c5bfa25 service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:28.844273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc549b4-97f3-48a1-a43e-96c19c5bfa25 service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:28.844540 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc549b4-97f3-48a1-a43e-96c19c5bfa25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:28.852912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc549b4-97f3-48a1-a43e-96c19c5bfa25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:28.854999 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc549b4-97f3-48a1-a43e-96c19c5bfa25 service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:28.864050 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 526/1051] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:30.499668 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bcf04-40b3-4f19-a5b7-b4caa307f017 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:30.500240 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bcf04-40b3-4f19-a5b7-b4caa307f017 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:30.500240 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bcf04-40b3-4f19-a5b7-b4caa307f017 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:30.501567 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 526/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:30.506333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785017b3-3248-4b13-b31e-ba12faab75fe None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:30.506752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785017b3-3248-4b13-b31e-ba12faab75fe None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:30.506877 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785017b3-3248-4b13-b31e-ba12faab75fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:30.526827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-785017b3-3248-4b13-b31e-ba12faab75fe None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:30.528169 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-785017b3-3248-4b13-b31e-ba12faab75fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:30.535725 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 527/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:49:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:30.697955 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bcf04-40b3-4f19-a5b7-b4caa307f017 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:30.710960 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bcf04-40b3-4f19-a5b7-b4caa307f017 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:30.716479 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66049165-3e1d-45c4-86ee-af38bfb17db8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:30.717054 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049165-3e1d-45c4-86ee-af38bfb17db8 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:30.717358 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049165-3e1d-45c4-86ee-af38bfb17db8 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:30.717626 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049165-3e1d-45c4-86ee-af38bfb17db8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:30.725412 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66049165-3e1d-45c4-86ee-af38bfb17db8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:30.726965 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66049165-3e1d-45c4-86ee-af38bfb17db8 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:30.736217 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 527/1054] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:32.456357 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1665-30ae-4e4b-a30c-3ccd240e6fe1 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:32.456882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1665-30ae-4e4b-a30c-3ccd240e6fe1 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:32.456882 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1665-30ae-4e4b-a30c-3ccd240e6fe1 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:32.458156 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 528/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:32.463310 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dea60b-f411-4163-9498-94fffe20ef16 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:32.463748 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dea60b-f411-4163-9498-94fffe20ef16 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:32.463855 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dea60b-f411-4163-9498-94fffe20ef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:32.483679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-e8dea60b-f411-4163-9498-94fffe20ef16 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:32.484895 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-e8dea60b-f411-4163-9498-94fffe20ef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:32.492589 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 528/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:49:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:32.652715 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1665-30ae-4e4b-a30c-3ccd240e6fe1 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:32.666676 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1665-30ae-4e4b-a30c-3ccd240e6fe1 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:32.671473 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c74d4-8efd-41c7-a3df-cb091b7addde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:32.672058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c74d4-8efd-41c7-a3df-cb091b7addde service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:32.672349 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c74d4-8efd-41c7-a3df-cb091b7addde service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:32.672607 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c74d4-8efd-41c7-a3df-cb091b7addde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:32.680482 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c74d4-8efd-41c7-a3df-cb091b7addde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:32.682241 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c74d4-8efd-41c7-a3df-cb091b7addde service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:32.691388 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 529/1057] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:35.025092 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01861d-c8a2-4785-9df2-88b63dc91ac4 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:35.025688 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01861d-c8a2-4785-9df2-88b63dc91ac4 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:35.025688 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01861d-c8a2-4785-9df2-88b63dc91ac4 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:35.026994 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 529/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:35.032273 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c90286-bca2-43c0-afe7-9a90bac1a047 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:35.032670 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c90286-bca2-43c0-afe7-9a90bac1a047 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:35.032813 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c90286-bca2-43c0-afe7-9a90bac1a047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:35.052104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-84c90286-bca2-43c0-afe7-9a90bac1a047 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:35.053334 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-84c90286-bca2-43c0-afe7-9a90bac1a047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:35.062164 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 530/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:35.412113 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01861d-c8a2-4785-9df2-88b63dc91ac4 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:35.423114 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01861d-c8a2-4785-9df2-88b63dc91ac4 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:35.426691 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda0cc3-ae04-4331-ad35-df9e0fe2a22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:35.427233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda0cc3-ae04-4331-ad35-df9e0fe2a22e service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:35.427505 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda0cc3-ae04-4331-ad35-df9e0fe2a22e service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:35.427774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda0cc3-ae04-4331-ad35-df9e0fe2a22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:35.436982 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda0cc3-ae04-4331-ad35-df9e0fe2a22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:35.441988 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda0cc3-ae04-4331-ad35-df9e0fe2a22e service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:35.447597 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 530/1060] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:37.976295 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa410-f04a-4ccb-ac5d-df72c8e50297 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:37.976858 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa410-f04a-4ccb-ac5d-df72c8e50297 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:37.977234 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa410-f04a-4ccb-ac5d-df72c8e50297 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:37.978823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 531/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:37.984670 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fbf43-c097-4c9f-8179-3d13d9712552 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:37.985115 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fbf43-c097-4c9f-8179-3d13d9712552 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:37.985286 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fbf43-c097-4c9f-8179-3d13d9712552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:38.004216 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-a08fbf43-c097-4c9f-8179-3d13d9712552 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:38.005425 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-a08fbf43-c097-4c9f-8179-3d13d9712552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:38.013003 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 531/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:38.355556 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aa410-f04a-4ccb-ac5d-df72c8e50297 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:38.366075 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aa410-f04a-4ccb-ac5d-df72c8e50297 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:38.370083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487c658-5232-4c39-be32-2d5186815644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:38.370912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c658-5232-4c39-be32-2d5186815644 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:38.371182 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c658-5232-4c39-be32-2d5186815644 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:38.371450 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c658-5232-4c39-be32-2d5186815644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:38.380021 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487c658-5232-4c39-be32-2d5186815644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:38.381452 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487c658-5232-4c39-be32-2d5186815644 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:38.390861 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 532/1063] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 20:49:41.149420 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab02817-c9f3-474b-890f-d2dc22a9b30f None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:41.149953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab02817-c9f3-474b-890f-d2dc22a9b30f None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:41.149953 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab02817-c9f3-474b-890f-d2dc22a9b30f None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:41.151529 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 532/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:41.157062 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908667e-da5d-4a8e-8d19-8d5190d2dd96 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:41.157502 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908667e-da5d-4a8e-8d19-8d5190d2dd96 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:41.157647 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908667e-da5d-4a8e-8d19-8d5190d2dd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:41.177112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-9908667e-da5d-4a8e-8d19-8d5190d2dd96 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:41.178832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-9908667e-da5d-4a8e-8d19-8d5190d2dd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:41.186770 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 533/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:41.531505 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab02817-c9f3-474b-890f-d2dc22a9b30f None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:41.544555 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab02817-c9f3-474b-890f-d2dc22a9b30f None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:41.548113 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b14f-a14c-4de1-a862-c3616cb07acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:41.548701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b14f-a14c-4de1-a862-c3616cb07acd service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:41.548975 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b14f-a14c-4de1-a862-c3616cb07acd service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:41.549280 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b14f-a14c-4de1-a862-c3616cb07acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:41.558534 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b14f-a14c-4de1-a862-c3616cb07acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:41.559942 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b14f-a14c-4de1-a862-c3616cb07acd service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:41.569172 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 533/1066] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:44.097084 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211b39-7f05-48d1-bdbd-b2881c905ab0 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:44.097653 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211b39-7f05-48d1-bdbd-b2881c905ab0 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:44.097653 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211b39-7f05-48d1-bdbd-b2881c905ab0 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:44.098892 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 534/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:44.104053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7c85-9d8b-4ca2-bd3b-966ce9046df6 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:44.104471 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7c85-9d8b-4ca2-bd3b-966ce9046df6 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:44.104632 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7c85-9d8b-4ca2-bd3b-966ce9046df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:44.111816 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=65 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:49:44.124399 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-e78b7c85-9d8b-4ca2-bd3b-966ce9046df6 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:44.126939 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-e78b7c85-9d8b-4ca2-bd3b-966ce9046df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:44.133141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 534/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:44.467541 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211b39-7f05-48d1-bdbd-b2881c905ab0 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:44.478059 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211b39-7f05-48d1-bdbd-b2881c905ab0 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:44.482194 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaeb4e-2d20-41f2-92db-98916bc5cc79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:44.482776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaeb4e-2d20-41f2-92db-98916bc5cc79 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:44.483049 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaeb4e-2d20-41f2-92db-98916bc5cc79 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:44.483316 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaeb4e-2d20-41f2-92db-98916bc5cc79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:44.491917 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eaeb4e-2d20-41f2-92db-98916bc5cc79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:44.493394 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eaeb4e-2d20-41f2-92db-98916bc5cc79 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:44.504660 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 535/1069] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:46.968492 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55023f-6da7-4777-874e-208d80d0f7ce None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:46.969051 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55023f-6da7-4777-874e-208d80d0f7ce None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:46.969051 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55023f-6da7-4777-874e-208d80d0f7ce None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:46.970434 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 535/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:46.975625 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d975e-ab1f-4a8e-8294-8b53df0f3865 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:46.976024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d975e-ab1f-4a8e-8294-8b53df0f3865 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:46.976181 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d975e-ab1f-4a8e-8294-8b53df0f3865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:46.984196 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=61 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:49:46.996474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-148d975e-ab1f-4a8e-8294-8b53df0f3865 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:46.998605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-148d975e-ab1f-4a8e-8294-8b53df0f3865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:47.005354 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 536/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:47.351459 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55023f-6da7-4777-874e-208d80d0f7ce None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:47.362085 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55023f-6da7-4777-874e-208d80d0f7ce None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:47.365540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489df6d9-0b85-40c7-9f51-34431a20d463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:47.366129 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df6d9-0b85-40c7-9f51-34431a20d463 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:47.366402 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df6d9-0b85-40c7-9f51-34431a20d463 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:47.366667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df6d9-0b85-40c7-9f51-34431a20d463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:47.375568 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489df6d9-0b85-40c7-9f51-34431a20d463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:47.377001 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489df6d9-0b85-40c7-9f51-34431a20d463 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:47.386853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 536/1072] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:49.867870 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bb249-64ee-4830-b0b0-7b394ce05b23 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:49.868409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bb249-64ee-4830-b0b0-7b394ce05b23 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:49.868409 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bb249-64ee-4830-b0b0-7b394ce05b23 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:49.869759 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 537/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:49.875736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3425-3d7f-4108-a03d-3f659d630449 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:49.876156 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3425-3d7f-4108-a03d-3f659d630449 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:49.876295 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3425-3d7f-4108-a03d-3f659d630449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:49.896274 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-6fad3425-3d7f-4108-a03d-3f659d630449 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:49.897499 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-6fad3425-3d7f-4108-a03d-3f659d630449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:49.905308 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 537/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:50.245021 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bb249-64ee-4830-b0b0-7b394ce05b23 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:50.256647 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bb249-64ee-4830-b0b0-7b394ce05b23 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:50.260104 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20fcb5-90c8-4274-94a3-bd4ff37cd0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:50.260691 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20fcb5-90c8-4274-94a3-bd4ff37cd0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:50.261038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20fcb5-90c8-4274-94a3-bd4ff37cd0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:50.261583 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20fcb5-90c8-4274-94a3-bd4ff37cd0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:50.270285 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20fcb5-90c8-4274-94a3-bd4ff37cd0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:50.271710 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20fcb5-90c8-4274-94a3-bd4ff37cd0f8 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:50.281256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 538/1075] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:52.750780 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb290b78-320a-4b4b-9969-bc41445ad18f None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:52.751323 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb290b78-320a-4b4b-9969-bc41445ad18f None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:52.751323 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb290b78-320a-4b4b-9969-bc41445ad18f None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:52.752649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 538/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:52.757844 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098772-7378-4c0e-a9aa-a7a0d0a30908 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:52.758283 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098772-7378-4c0e-a9aa-a7a0d0a30908 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:52.758379 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098772-7378-4c0e-a9aa-a7a0d0a30908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:52.778240 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-c4098772-7378-4c0e-a9aa-a7a0d0a30908 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:52.779416 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-c4098772-7378-4c0e-a9aa-a7a0d0a30908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:52.787015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 539/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:53.128834 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb290b78-320a-4b4b-9969-bc41445ad18f None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:53.139930 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb290b78-320a-4b4b-9969-bc41445ad18f None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:53.143386 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f3a21-2c08-489b-94ff-d2b86cba279e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:53.143962 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f3a21-2c08-489b-94ff-d2b86cba279e service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:53.144233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f3a21-2c08-489b-94ff-d2b86cba279e service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:53.144497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f3a21-2c08-489b-94ff-d2b86cba279e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:53.153041 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f3a21-2c08-489b-94ff-d2b86cba279e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:53.154539 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f3a21-2c08-489b-94ff-d2b86cba279e service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:53.163649 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 539/1078] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:55.677437 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb88b3-131f-4f06-b624-d85dadec8ac1 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:55.677999 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb88b3-131f-4f06-b624-d85dadec8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:55.677999 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb88b3-131f-4f06-b624-d85dadec8ac1 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:55.679306 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 540/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:55.684863 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd926b55-f80e-4b1d-b28b-cde67969574f None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:55.685317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd926b55-f80e-4b1d-b28b-cde67969574f None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:55.685502 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd926b55-f80e-4b1d-b28b-cde67969574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:55.704954 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-dd926b55-f80e-4b1d-b28b-cde67969574f None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:55.706165 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-dd926b55-f80e-4b1d-b28b-cde67969574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:55.713768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 540/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:56.051401 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb88b3-131f-4f06-b624-d85dadec8ac1 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:56.062819 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb88b3-131f-4f06-b624-d85dadec8ac1 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:56.066281 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30fab-1eb5-451d-91bd-b7b754e76f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:56.066871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30fab-1eb5-451d-91bd-b7b754e76f44 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:56.067138 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30fab-1eb5-451d-91bd-b7b754e76f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:56.067410 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30fab-1eb5-451d-91bd-b7b754e76f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:56.077972 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e30fab-1eb5-451d-91bd-b7b754e76f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:56.079604 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e30fab-1eb5-451d-91bd-b7b754e76f44 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:56.090944 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 541/1081] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:49:58.633822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96a52d-5869-401f-91fd-14a639e28f1f None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:58.634384 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96a52d-5869-401f-91fd-14a639e28f1f None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:58.634384 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96a52d-5869-401f-91fd-14a639e28f1f None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:58.635631 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 541/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:49:58.641512 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d44f6-2c08-48b2-9776-d1a44418f860 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:58.641968 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d44f6-2c08-48b2-9776-d1a44418f860 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:58.642076 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d44f6-2c08-48b2-9776-d1a44418f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:58.661578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-1e9d44f6-2c08-48b2-9776-d1a44418f860 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:49:58.662769 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-1e9d44f6-2c08-48b2-9776-d1a44418f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:49:58.671040 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 542/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:49:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:49:59.009673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96a52d-5869-401f-91fd-14a639e28f1f None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:49:59.020809 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96a52d-5869-401f-91fd-14a639e28f1f None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:49:59.030585 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffef400-c08c-4c9f-8b94-fd6d16037b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:49:59.030585 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffef400-c08c-4c9f-8b94-fd6d16037b6f service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:49:59.030585 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffef400-c08c-4c9f-8b94-fd6d16037b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:49:59.030585 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffef400-c08c-4c9f-8b94-fd6d16037b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:49:59.033986 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffef400-c08c-4c9f-8b94-fd6d16037b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:49:59.035404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffef400-c08c-4c9f-8b94-fd6d16037b6f service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:49:59.044536 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 542/1084] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:49:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:01.581082 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5104-8a19-4db1-ae46-2fb9c57236a1 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:01.581672 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5104-8a19-4db1-ae46-2fb9c57236a1 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:01.581672 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5104-8a19-4db1-ae46-2fb9c57236a1 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:01.583026 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 543/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:50:01.588182 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203122c-71b5-4500-98a5-83ec4d452adf None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:01.588603 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203122c-71b5-4500-98a5-83ec4d452adf None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:01.588754 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203122c-71b5-4500-98a5-83ec4d452adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:01.608461 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-b203122c-71b5-4500-98a5-83ec4d452adf None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:50:01.609698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-b203122c-71b5-4500-98a5-83ec4d452adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:50:01.617290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 543/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:50:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:50:01.964322 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb5104-8a19-4db1-ae46-2fb9c57236a1 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:50:01.975516 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb5104-8a19-4db1-ae46-2fb9c57236a1 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:50:01.978902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b627e3-4db6-4d18-953a-44a712ba8b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:50:01.979476 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b627e3-4db6-4d18-953a-44a712ba8b2a service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:01.979752 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b627e3-4db6-4d18-953a-44a712ba8b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:01.980021 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b627e3-4db6-4d18-953a-44a712ba8b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:01.989497 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b627e3-4db6-4d18-953a-44a712ba8b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:50:01.990915 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b627e3-4db6-4d18-953a-44a712ba8b2a service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:50:02.000646 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 544/1087] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:50:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:11.603176 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=29 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:11.995975 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=26 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:26.830528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9457e0-344c-4c46-88bb-8f84f5a386f4 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:26.831061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9457e0-344c-4c46-88bb-8f84f5a386f4 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:26.831061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9457e0-344c-4c46-88bb-8f84f5a386f4 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:26.832413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 544/1088] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:50:26.837526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436a375-b3ff-4ed0-9a74-925611bd32f9 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:26.837971 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436a375-b3ff-4ed0-9a74-925611bd32f9 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:26.838079 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436a375-b3ff-4ed0-9a74-925611bd32f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:26.857676 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-4436a375-b3ff-4ed0-9a74-925611bd32f9 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:50:26.858848 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-4436a375-b3ff-4ed0-9a74-925611bd32f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:50:26.866391 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 545/1089] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:50:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:50:27.218217 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d89b4-1663-44dd-807c-d297a83c602f None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:27.218502 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d89b4-1663-44dd-807c-d297a83c602f None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:27.218774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d89b4-1663-44dd-807c-d297a83c602f None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:27.220098 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 545/1090] 10.222.0.52 () {54 vars in 962 bytes} [Sat Sep 17 20:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:50:27.225585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0768c9e-a8e0-45d1-8302-2558c6ae3f76 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:27.225863 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0768c9e-a8e0-45d1-8302-2558c6ae3f76 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:27.226131 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0768c9e-a8e0-45d1-8302-2558c6ae3f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:27.245287 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-e0768c9e-a8e0-45d1-8302-2558c6ae3f76 None None] MFA Rules not processed for user `d8200d2f30fa47dc9799dfa26a81109a`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:50:27.246460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-e0768c9e-a8e0-45d1-8302-2558c6ae3f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:50:27.253130 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 546/1091] 10.222.0.52 () {58 vars in 1059 bytes} [Sat Sep 17 20:50:27 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:50:27.260545 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d89b4-1663-44dd-807c-d297a83c602f None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:50:27.271683 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d89b4-1663-44dd-807c-d297a83c602f None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:50:27.275187 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b9c10-ff02-43be-9c6b-976d5fb85c2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8200d2f30fa47dc9799dfa26a81109a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:50:27.275768 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b9c10-ff02-43be-9c6b-976d5fb85c2e service glance] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:27.276046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b9c10-ff02-43be-9c6b-976d5fb85c2e service glance] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:27.276318 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b9c10-ff02-43be-9c6b-976d5fb85c2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:27.285794 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b9c10-ff02-43be-9c6b-976d5fb85c2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:50:27.287206 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b9c10-ff02-43be-9c6b-976d5fb85c2e service glance] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:50:27.296607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 546/1092] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:50:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:29.797058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28ced-d8bf-458c-8d19-0320db37e62c None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:29.797628 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28ced-d8bf-458c-8d19-0320db37e62c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:29.797628 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28ced-d8bf-458c-8d19-0320db37e62c None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:29.798880 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 547/1093] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:50:29.804300 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19093-9323-4abc-b8d4-a90047ee9a04 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:29.804710 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19093-9323-4abc-b8d4-a90047ee9a04 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:29.804834 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19093-9323-4abc-b8d4-a90047ee9a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:29.823938 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-4fe19093-9323-4abc-b8d4-a90047ee9a04 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:50:29.825125 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-4fe19093-9323-4abc-b8d4-a90047ee9a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:50:29.833118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 547/1094] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:50:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:50:30.173353 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28ced-d8bf-458c-8d19-0320db37e62c None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:50:30.185828 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28ced-d8bf-458c-8d19-0320db37e62c None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:50:30.190295 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f499d3d-848a-40bf-b346-893f58a46095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:50:30.190904 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499d3d-848a-40bf-b346-893f58a46095 admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:30.191175 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499d3d-848a-40bf-b346-893f58a46095 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:30.191441 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499d3d-848a-40bf-b346-893f58a46095 admin admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:30.192065 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f499d3d-848a-40bf-b346-893f58a46095 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:50:30.193843 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WARNING py.warnings [None req-8f499d3d-848a-40bf-b346-893f58a46095 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:50:30.193843 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: warnings.warn(msg) Sep 17 20:50:30.193843 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: Sep 17 20:50:30.194969 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f499d3d-848a-40bf-b346-893f58a46095 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:50:30.213611 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 548/1095] 10.222.0.52 () {56 vars in 1108 bytes} [Sat Sep 17 20:50:30 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:50:32.606185 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf47994-936b-4ee6-bd4b-da14854f54d0 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:32.606709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf47994-936b-4ee6-bd4b-da14854f54d0 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:32.606709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf47994-936b-4ee6-bd4b-da14854f54d0 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:32.608148 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 548/1096] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:50:32.613429 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd91d72-ef11-48a9-aa18-274cececa8e1 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:32.613862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd91d72-ef11-48a9-aa18-274cececa8e1 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:32.614102 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd91d72-ef11-48a9-aa18-274cececa8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:32.634124 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-5dd91d72-ef11-48a9-aa18-274cececa8e1 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:50:32.635317 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-5dd91d72-ef11-48a9-aa18-274cececa8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:50:32.643697 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 549/1097] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:50:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:50:32.991479 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf47994-936b-4ee6-bd4b-da14854f54d0 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:50:33.005702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf47994-936b-4ee6-bd4b-da14854f54d0 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:50:33.010604 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633173-d2af-4bdc-818e-73630b387f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:50:33.011187 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633173-d2af-4bdc-818e-73630b387f48 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:33.011466 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633173-d2af-4bdc-818e-73630b387f48 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:33.011738 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633173-d2af-4bdc-818e-73630b387f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:33.019865 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5633173-d2af-4bdc-818e-73630b387f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:50:33.021473 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5633173-d2af-4bdc-818e-73630b387f48 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:50:33.031003 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 549/1098] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:50:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:35.640354 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab6dd-187d-43c7-a61e-ddd58c69b80c None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:35.640899 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab6dd-187d-43c7-a61e-ddd58c69b80c None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:35.640899 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab6dd-187d-43c7-a61e-ddd58c69b80c None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:35.642259 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 550/1099] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:50:35.647480 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c747e1-e37e-4b94-8e8b-1380de1f7a66 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:35.647876 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c747e1-e37e-4b94-8e8b-1380de1f7a66 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:35.648017 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c747e1-e37e-4b94-8e8b-1380de1f7a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:35.667408 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-e2c747e1-e37e-4b94-8e8b-1380de1f7a66 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:50:35.668602 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-e2c747e1-e37e-4b94-8e8b-1380de1f7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:50:35.676892 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 550/1100] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:50:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:50:36.015181 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afab6dd-187d-43c7-a61e-ddd58c69b80c None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:50:36.025741 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afab6dd-187d-43c7-a61e-ddd58c69b80c None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:50:36.029083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e3fac-8e32-49c6-9504-6be2bc51f7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:50:36.029726 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e3fac-8e32-49c6-9504-6be2bc51f7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:36.029998 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e3fac-8e32-49c6-9504-6be2bc51f7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:36.030295 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e3fac-8e32-49c6-9504-6be2bc51f7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:36.040649 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e3fac-8e32-49c6-9504-6be2bc51f7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:50:36.042101 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e3fac-8e32-49c6-9504-6be2bc51f7c7 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:50:36.051731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 551/1101] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:50:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:38.492415 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1527501-05f2-4ac1-98cb-d83259080604 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:38.492955 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1527501-05f2-4ac1-98cb-d83259080604 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:38.493086 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1527501-05f2-4ac1-98cb-d83259080604 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:38.494489 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 551/1102] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:50:38.500407 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a38ce-778f-4e85-8b06-112ba4134d19 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:38.504426 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a38ce-778f-4e85-8b06-112ba4134d19 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:38.504720 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a38ce-778f-4e85-8b06-112ba4134d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:38.524793 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-3f5a38ce-778f-4e85-8b06-112ba4134d19 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:50:38.526004 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-3f5a38ce-778f-4e85-8b06-112ba4134d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:50:38.534165 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 552/1103] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:50:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:50:38.870634 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1527501-05f2-4ac1-98cb-d83259080604 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:50:38.881927 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1527501-05f2-4ac1-98cb-d83259080604 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:50:38.885397 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba413524-7c0b-42e2-829a-491f1293d022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:50:38.885980 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413524-7c0b-42e2-829a-491f1293d022 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:38.886254 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413524-7c0b-42e2-829a-491f1293d022 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:38.886524 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413524-7c0b-42e2-829a-491f1293d022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:38.895913 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba413524-7c0b-42e2-829a-491f1293d022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:50:38.897418 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba413524-7c0b-42e2-829a-491f1293d022 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:50:38.906844 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 552/1104] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:50:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:41.469351 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de73bb-8112-4738-96fd-e6807a6533d1 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:41.469988 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de73bb-8112-4738-96fd-e6807a6533d1 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:41.469988 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de73bb-8112-4738-96fd-e6807a6533d1 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:41.471220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 553/1105] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:50:41.476591 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e1394-c898-46b1-a447-b2efc17b9811 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:41.477016 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e1394-c898-46b1-a447-b2efc17b9811 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:41.477110 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e1394-c898-46b1-a447-b2efc17b9811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:41.496578 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-977e1394-c898-46b1-a447-b2efc17b9811 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:50:41.497798 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-977e1394-c898-46b1-a447-b2efc17b9811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:50:41.506427 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 553/1106] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:50:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:50:41.844722 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de73bb-8112-4738-96fd-e6807a6533d1 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:50:41.855166 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de73bb-8112-4738-96fd-e6807a6533d1 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:50:41.858622 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189402b-6a57-47e3-82a7-a40a2c32eace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:50:41.859305 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189402b-6a57-47e3-82a7-a40a2c32eace service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:41.859584 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189402b-6a57-47e3-82a7-a40a2c32eace service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:41.859859 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189402b-6a57-47e3-82a7-a40a2c32eace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:41.868920 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189402b-6a57-47e3-82a7-a40a2c32eace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:50:41.870352 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189402b-6a57-47e3-82a7-a40a2c32eace service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:50:41.880348 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 554/1107] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:50:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:44.750841 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdcbd0-f655-4e1c-9fda-4a349f2e2466 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:44.751418 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdcbd0-f655-4e1c-9fda-4a349f2e2466 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:44.751418 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdcbd0-f655-4e1c-9fda-4a349f2e2466 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:44.752946 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 554/1108] 10.222.0.52 () {54 vars in 927 bytes} [Sat Sep 17 20:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:50:44.758047 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d461-fa7d-4bad-bafc-39d23736da61 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:44.758498 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d461-fa7d-4bad-bafc-39d23736da61 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:44.758603 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d461-fa7d-4bad-bafc-39d23736da61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:44.778002 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-2331d461-fa7d-4bad-bafc-39d23736da61 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:50:44.779177 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-2331d461-fa7d-4bad-bafc-39d23736da61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:50:44.786841 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 555/1109] 10.222.0.52 () {58 vars in 1024 bytes} [Sat Sep 17 20:50:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:50:45.125096 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdcbd0-f655-4e1c-9fda-4a349f2e2466 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:50:45.136004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdcbd0-f655-4e1c-9fda-4a349f2e2466 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:50:45.139475 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f96f5-e98e-4a28-b4fe-d588c7dfdc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:50:45.145489 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f96f5-e98e-4a28-b4fe-d588c7dfdc46 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:50:45.145489 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f96f5-e98e-4a28-b4fe-d588c7dfdc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:50:45.145489 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f96f5-e98e-4a28-b4fe-d588c7dfdc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:50:45.149531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f96f5-e98e-4a28-b4fe-d588c7dfdc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:50:45.150967 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f96f5-e98e-4a28-b4fe-d588c7dfdc46 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:50:45.160173 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 555/1110] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:50:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:54.773266 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=33 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:55.157076 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=33 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:11.873677 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02685-793d-4b29-b2b7-562558c8b997 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:11.874361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02685-793d-4b29-b2b7-562558c8b997 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:11.874361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02685-793d-4b29-b2b7-562558c8b997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:11.894112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-43d02685-793d-4b29-b2b7-562558c8b997 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:52:11.895285 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-43d02685-793d-4b29-b2b7-562558c8b997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:52:11.902963 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 556/1111] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:52:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:52:11.910932 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9cdec-8677-40cc-a82e-ad5d821b957c None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:11.911459 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9cdec-8677-40cc-a82e-ad5d821b957c None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:11.911459 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9cdec-8677-40cc-a82e-ad5d821b957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:11.930672 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-a1d9cdec-8677-40cc-a82e-ad5d821b957c None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:52:11.931831 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-a1d9cdec-8677-40cc-a82e-ad5d821b957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:52:11.939395 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 556/1112] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:52:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:52:11.943834 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02685-793d-4b29-b2b7-562558c8b997 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:11.954029 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02685-793d-4b29-b2b7-562558c8b997 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:11.958510 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:11.959091 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:11.959383 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:11.959636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:11.960267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:52:11.960575 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:11.961832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WARNING py.warnings [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:52:11.961832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: warnings.warn(msg) Sep 17 20:52:11.961832 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: Sep 17 20:52:11.962711 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:11.974311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 557/1113] 10.222.0.52 () {58 vars in 1153 bytes} [Sat Sep 17 20:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:52:11.982237 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9cdec-8677-40cc-a82e-ad5d821b957c None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:11.991180 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9cdec-8677-40cc-a82e-ad5d821b957c None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:11.996090 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bfc1f-d883-4d47-a921-3333755ceac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:11.996667 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfc1f-d883-4d47-a921-3333755ceac1 admin admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:11.996942 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfc1f-d883-4d47-a921-3333755ceac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:11.997235 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfc1f-d883-4d47-a921-3333755ceac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:11.997854 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bfc1f-d883-4d47-a921-3333755ceac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:11.999590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WARNING py.warnings [None req-fa8bfc1f-d883-4d47-a921-3333755ceac1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:52:11.999590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: warnings.warn(msg) Sep 17 20:52:11.999590 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: Sep 17 20:52:12.000777 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bfc1f-d883-4d47-a921-3333755ceac1 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:12.091187 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 557/1114] 10.222.0.52 () {60 vars in 1153 bytes} [Sat Sep 17 20:52:11 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:52:12.095513 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:12.105646 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51d8df-5d0d-4663-919d-6b1ad4a9f0ee admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:12.164083 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b7ff-72c1-446b-8ceb-a80ed484a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:12.164673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b7ff-72c1-446b-8ceb-a80ed484a594 admin admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.164947 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b7ff-72c1-446b-8ceb-a80ed484a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.165331 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b7ff-72c1-446b-8ceb-a80ed484a594 admin admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.165964 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b7ff-72c1-446b-8ceb-a80ed484a594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:12.166957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WARNING py.warnings [None req-f124b7ff-72c1-446b-8ceb-a80ed484a594 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:52:12.166957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: warnings.warn(msg) Sep 17 20:52:12.166957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: Sep 17 20:52:12.168209 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b7ff-72c1-446b-8ceb-a80ed484a594 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:12.262626 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 558/1115] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:52:12 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:52:12.266780 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bfc1f-d883-4d47-a921-3333755ceac1 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:12.277223 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bfc1f-d883-4d47-a921-3333755ceac1 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:12.281871 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4be55d-d883-45e5-aaf7-1dc8e617a19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:12.282454 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4be55d-d883-45e5-aaf7-1dc8e617a19a admin admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.282728 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4be55d-d883-45e5-aaf7-1dc8e617a19a admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.283040 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4be55d-d883-45e5-aaf7-1dc8e617a19a admin admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.283660 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4be55d-d883-45e5-aaf7-1dc8e617a19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:12.284657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WARNING py.warnings [None req-7d4be55d-d883-45e5-aaf7-1dc8e617a19a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:52:12.284657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: warnings.warn(msg) Sep 17 20:52:12.284657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: Sep 17 20:52:12.285563 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4be55d-d883-45e5-aaf7-1dc8e617a19a admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:12.299329 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 558/1116] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:52:12.303282 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b7ff-72c1-446b-8ceb-a80ed484a594 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:12.314096 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b7ff-72c1-446b-8ceb-a80ed484a594 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:12.318957 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be6e35-4d30-4c13-832d-0c20f694f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:12.319544 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6e35-4d30-4c13-832d-0c20f694f53e admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.319821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6e35-4d30-4c13-832d-0c20f694f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.320208 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6e35-4d30-4c13-832d-0c20f694f53e admin admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.320840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be6e35-4d30-4c13-832d-0c20f694f53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:12.321911 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WARNING py.warnings [None req-19be6e35-4d30-4c13-832d-0c20f694f53e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:52:12.321911 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: warnings.warn(msg) Sep 17 20:52:12.321911 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: Sep 17 20:52:12.322860 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be6e35-4d30-4c13-832d-0c20f694f53e admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:12.336162 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 559/1117] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:52:12.340506 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4be55d-d883-45e5-aaf7-1dc8e617a19a admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:12.350380 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4be55d-d883-45e5-aaf7-1dc8e617a19a admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:12.355622 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb016497-784e-4ae5-a7cf-978f5694a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:12.357668 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016497-784e-4ae5-a7cf-978f5694a176 admin admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.357668 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016497-784e-4ae5-a7cf-978f5694a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.357668 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016497-784e-4ae5-a7cf-978f5694a176 admin admin] PATH_INFO: `/v3/projects/702cb3aeddea47c08bde0e7d13b0d8a4/users/931d451558194dad8e96e43ab06d9193/roles/dc25b689a7f8405a807147fca4ae3d0b` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.372379 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb016497-784e-4ae5-a7cf-978f5694a176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702cb3aeddea47c08bde0e7d13b0d8a4, user_id=931d451558194dad8e96e43ab06d9193, role_id=dc25b689a7f8405a807147fca4ae3d0b)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:12.373456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WARNING py.warnings [None req-cb016497-784e-4ae5-a7cf-978f5694a176 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:52:12.373456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: warnings.warn(msg) Sep 17 20:52:12.373456 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: Sep 17 20:52:12.375389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb016497-784e-4ae5-a7cf-978f5694a176 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:12.433401 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 559/1118] 10.222.0.52 () {60 vars in 1483 bytes} [Sat Sep 17 20:52:12 2022] PUT /identity/v3/projects/702cb3aeddea47c08bde0e7d13b0d8a4/users/931d451558194dad8e96e43ab06d9193/roles/dc25b689a7f8405a807147fca4ae3d0b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:52:12.445521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526deda6-1b7f-4b0b-95dd-281f20a125a8 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.445810 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526deda6-1b7f-4b0b-95dd-281f20a125a8 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.446085 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526deda6-1b7f-4b0b-95dd-281f20a125a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.473509 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-526deda6-1b7f-4b0b-95dd-281f20a125a8 None None] MFA Rules not processed for user `931d451558194dad8e96e43ab06d9193`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:52:12.474751 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-526deda6-1b7f-4b0b-95dd-281f20a125a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:52:12.540866 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 560/1119] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:52:12 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:52:12.554078 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d65c7-bfc0-4172-bfc8-68237b74b5b9 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.554969 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d65c7-bfc0-4172-bfc8-68237b74b5b9 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.555218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d65c7-bfc0-4172-bfc8-68237b74b5b9 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.556592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 560/1120] 10.222.0.52 () {54 vars in 964 bytes} [Sat Sep 17 20:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:52:12.561489 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f8d1-63f1-4d32-81f4-22205a1fd8f1 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.561773 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f8d1-63f1-4d32-81f4-22205a1fd8f1 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.562076 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f8d1-63f1-4d32-81f4-22205a1fd8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.592714 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-4e10f8d1-63f1-4d32-81f4-22205a1fd8f1 None None] MFA Rules not processed for user `681cab6042a3486087c55058843deeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:52:12.594038 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-4e10f8d1-63f1-4d32-81f4-22205a1fd8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:52:12.627153 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:12.645326 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 561/1121] 10.222.0.52 () {58 vars in 1061 bytes} [Sat Sep 17 20:52:12 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:52:12.653560 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d65c7-bfc0-4172-bfc8-68237b74b5b9 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:12.664753 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d65c7-bfc0-4172-bfc8-68237b74b5b9 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:12.668210 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d417e-b4d6-4652-8568-d6dd45b32411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681cab6042a3486087c55058843deeb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:12.668791 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d417e-b4d6-4652-8568-d6dd45b32411 service cinder] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.669068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d417e-b4d6-4652-8568-d6dd45b32411 service cinder] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.669374 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d417e-b4d6-4652-8568-d6dd45b32411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.677359 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d417e-b4d6-4652-8568-d6dd45b32411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:12.678784 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d417e-b4d6-4652-8568-d6dd45b32411 service cinder] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:12.687298 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 561/1122] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:52:12 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:52:12.725763 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5f85f-a4e4-4553-be2e-24957df42d3b None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.726049 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5f85f-a4e4-4553-be2e-24957df42d3b None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.726937 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5f85f-a4e4-4553-be2e-24957df42d3b None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.728170 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 562/1123] 10.222.0.52 () {52 vars in 830 bytes} [Sat Sep 17 20:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:52:12.731636 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d417e-b4d6-4652-8568-d6dd45b32411 service cinder] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:12.792574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d417e-b4d6-4652-8568-d6dd45b32411 service cinder] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:12.797022 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:12.797674 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:12.797950 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:12.798219 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] PATH_INFO: `/v3/users/931d451558194dad8e96e43ab06d9193` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:12.799339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931d451558194dad8e96e43ab06d9193)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:12.800346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WARNING py.warnings [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:52:12.800346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: warnings.warn(msg) Sep 17 20:52:12.800346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: Sep 17 20:52:12.801587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:13.005918 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931d451558194dad8e96e43ab06d9193'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:13.006668 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931d451558194dad8e96e43ab06d9193'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:13.076181 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931d451558194dad8e96e43ab06d9193'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:13.090454 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931d451558194dad8e96e43ab06d9193'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:13.091207 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931d451558194dad8e96e43ab06d9193'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:13.111795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:13.120261 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 562/1124] 10.222.0.52 () {58 vars in 1224 bytes} [Sat Sep 17 20:52:12 2022] DELETE /identity/v3/users/931d451558194dad8e96e43ab06d9193 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:52:13.124719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e59604-a867-41d1-bf4c-4768e3168186 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:13.125222 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e59604-a867-41d1-bf4c-4768e3168186 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:13.125336 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e59604-a867-41d1-bf4c-4768e3168186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:13.145094 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-49e59604-a867-41d1-bf4c-4768e3168186 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:52:13.146336 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-49e59604-a867-41d1-bf4c-4768e3168186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:52:13.205192 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 563/1125] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:52:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:52:13.214914 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:13.216319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:52:13.284929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a279240-90bf-4c29-af88-987e21353d49 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:13.288520 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee397267-887d-43b0-aed0-4258949b199b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:13.289690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee397267-887d-43b0-aed0-4258949b199b service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:13.295150 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee397267-887d-43b0-aed0-4258949b199b service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:13.295150 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee397267-887d-43b0-aed0-4258949b199b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:13.299043 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee397267-887d-43b0-aed0-4258949b199b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:13.300482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee397267-887d-43b0-aed0-4258949b199b service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:13.309903 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 563/1126] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:52:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:52:13.787113 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e59604-a867-41d1-bf4c-4768e3168186 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:52:13.788586 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-49e59604-a867-41d1-bf4c-4768e3168186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:52:13.801496 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e59604-a867-41d1-bf4c-4768e3168186 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:52:13.809933 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:52:13.810588 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:52:13.810865 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:52:13.811133 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] PATH_INFO: `/v3/projects/702cb3aeddea47c08bde0e7d13b0d8a4` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:52:13.812265 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=702cb3aeddea47c08bde0e7d13b0d8a4)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:52:13.813324 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WARNING py.warnings [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:52:13.813324 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: warnings.warn(msg) Sep 17 20:52:13.813324 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: Sep 17 20:52:13.814635 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:52:13.939442 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702cb3aeddea47c08bde0e7d13b0d8a4', 'request_id': 'req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:13.945778 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702cb3aeddea47c08bde0e7d13b0d8a4', 'request_id': 'req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:14.021622 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702cb3aeddea47c08bde0e7d13b0d8a4', 'request_id': 'req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:14.041639 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] The token cache is being invalidate because project 702cb3aeddea47c08bde0e7d13b0d8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 20:52:14.041866 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:14.042606 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-4946b9f0-2d0c-4443-9a3c-da74e3f6cc6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 20:52:14.044204 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 564/1127] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 17 20:52:13 2022] DELETE /identity/v3/projects/702cb3aeddea47c08bde0e7d13b0d8a4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:52:23.305853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:DELETE=1,keystone:SELECT=33 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:24.037701 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:31.979009 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebd5dd-ad59-4524-94b6-0a0c273b843a None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:31.979606 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebd5dd-ad59-4524-94b6-0a0c273b843a None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:31.979606 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebd5dd-ad59-4524-94b6-0a0c273b843a None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:31.980867 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:53:31.985603 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ed842-db28-462d-a754-a1a0189da506 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:31.986004 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ed842-db28-462d-a754-a1a0189da506 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:31.986145 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ed842-db28-462d-a754-a1a0189da506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:32.006067 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-bf2ed842-db28-462d-a754-a1a0189da506 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:53:32.007665 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-bf2ed842-db28-462d-a754-a1a0189da506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:32.066072 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:53:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:53:32.227362 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebd5dd-ad59-4524-94b6-0a0c273b843a None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:53:32.229200 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-f1ebd5dd-ad59-4524-94b6-0a0c273b843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:32.305984 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebd5dd-ad59-4524-94b6-0a0c273b843a None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:53:32.310986 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cd468-3383-4467-b782-3c19cd219f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:53:32.311583 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cd468-3383-4467-b782-3c19cd219f00 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:32.311859 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cd468-3383-4467-b782-3c19cd219f00 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:32.312125 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cd468-3383-4467-b782-3c19cd219f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:32.320046 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cd468-3383-4467-b782-3c19cd219f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:53:32.321694 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cd468-3383-4467-b782-3c19cd219f00 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:53:32.330851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 565/1130] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:53:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:53:34.002080 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597522f-0763-4fcc-a92a-07bbf9ac0dc9 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:34.002629 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597522f-0763-4fcc-a92a-07bbf9ac0dc9 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:34.002629 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597522f-0763-4fcc-a92a-07bbf9ac0dc9 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:34.003979 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:53:34.008897 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f6f2f-ae69-437e-953a-cf1330b6af7f None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:34.013190 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f6f2f-ae69-437e-953a-cf1330b6af7f None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:34.013190 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f6f2f-ae69-437e-953a-cf1330b6af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:34.029988 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-ac6f6f2f-ae69-437e-953a-cf1330b6af7f None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:53:34.031184 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-ac6f6f2f-ae69-437e-953a-cf1330b6af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:34.039912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:53:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:53:34.197884 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597522f-0763-4fcc-a92a-07bbf9ac0dc9 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:53:34.211578 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597522f-0763-4fcc-a92a-07bbf9ac0dc9 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:53:34.216396 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19d1ee-313c-4302-b1c0-b0d17e32eb48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:53:34.216973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19d1ee-313c-4302-b1c0-b0d17e32eb48 service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:34.217281 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19d1ee-313c-4302-b1c0-b0d17e32eb48 service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:34.217553 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19d1ee-313c-4302-b1c0-b0d17e32eb48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:34.225387 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19d1ee-313c-4302-b1c0-b0d17e32eb48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:53:34.227246 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19d1ee-313c-4302-b1c0-b0d17e32eb48 service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:53:34.236478 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 567/1133] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:53:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:53:37.557844 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e16d-afef-462b-92bd-d353f7916515 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:37.558400 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e16d-afef-462b-92bd-d353f7916515 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:37.558400 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e16d-afef-462b-92bd-d353f7916515 None None] PATH_INFO: `/v3` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:37.559616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 567/1134] 10.222.0.27 () {54 vars in 925 bytes} [Sat Sep 17 20:53:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 20:53:37.566307 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802afba-c47c-4599-9e8b-891605f63c34 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:37.566796 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802afba-c47c-4599-9e8b-891605f63c34 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:37.566893 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802afba-c47c-4599-9e8b-891605f63c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:37.598478 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-a802afba-c47c-4599-9e8b-891605f63c34 None None] MFA Rules not processed for user `88caaed0c8c4438ea57d2f313fcf287a`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:53:37.599679 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-a802afba-c47c-4599-9e8b-891605f63c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:37.661623 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 568/1135] 10.222.0.27 () {58 vars in 1015 bytes} [Sat Sep 17 20:53:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:53:41.648688 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248a987-1c9b-4b8b-ab51-e04cc235f6ad None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:41.649095 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248a987-1c9b-4b8b-ab51-e04cc235f6ad None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:41.649261 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248a987-1c9b-4b8b-ab51-e04cc235f6ad None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:41.651059 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 568/1136] 10.222.0.52 () {54 vars in 961 bytes} [Sat Sep 17 20:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:53:41.657019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630bf8-7002-41fb-ae93-abaee787a20a None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:41.657493 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630bf8-7002-41fb-ae93-abaee787a20a None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:41.657587 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630bf8-7002-41fb-ae93-abaee787a20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:41.677365 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-35630bf8-7002-41fb-ae93-abaee787a20a None None] MFA Rules not processed for user `88caaed0c8c4438ea57d2f313fcf287a`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:53:41.678539 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-35630bf8-7002-41fb-ae93-abaee787a20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:41.687457 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 569/1137] 10.222.0.52 () {58 vars in 1058 bytes} [Sat Sep 17 20:53:41 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:53:41.694625 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248a987-1c9b-4b8b-ab51-e04cc235f6ad None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:53:41.707587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248a987-1c9b-4b8b-ab51-e04cc235f6ad None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:53:41.712383 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a489c-3c0a-47e4-95b9-040ab07c54c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88caaed0c8c4438ea57d2f313fcf287a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:53:41.712944 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a489c-3c0a-47e4-95b9-040ab07c54c0 service placement] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:41.713261 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a489c-3c0a-47e4-95b9-040ab07c54c0 service placement] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:41.713519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a489c-3c0a-47e4-95b9-040ab07c54c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:41.721533 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a489c-3c0a-47e4-95b9-040ab07c54c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:53:41.723170 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a489c-3c0a-47e4-95b9-040ab07c54c0 service placement] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:53:41.733122 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 569/1138] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:53:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:53:46.298383 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31da66-dd5e-4797-b7ba-a795e8fd45c5 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:46.298925 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31da66-dd5e-4797-b7ba-a795e8fd45c5 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:46.298925 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31da66-dd5e-4797-b7ba-a795e8fd45c5 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:46.300224 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:53:46.304883 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ac495-3804-404c-9b98-c6c9de0bea9a None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:46.305288 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ac495-3804-404c-9b98-c6c9de0bea9a None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:46.305451 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ac495-3804-404c-9b98-c6c9de0bea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:46.325133 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-da7ac495-3804-404c-9b98-c6c9de0bea9a None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:53:46.326464 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-da7ac495-3804-404c-9b98-c6c9de0bea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:46.334154 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:53:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:53:46.492268 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31da66-dd5e-4797-b7ba-a795e8fd45c5 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:53:46.506252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31da66-dd5e-4797-b7ba-a795e8fd45c5 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:53:46.511981 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8586f-b8ba-4e3c-a5e9-cacdb18aee5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:53:46.512566 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8586f-b8ba-4e3c-a5e9-cacdb18aee5d service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:46.512841 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8586f-b8ba-4e3c-a5e9-cacdb18aee5d service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:46.513112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8586f-b8ba-4e3c-a5e9-cacdb18aee5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:46.521447 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8586f-b8ba-4e3c-a5e9-cacdb18aee5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:53:46.523015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8586f-b8ba-4e3c-a5e9-cacdb18aee5d service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:53:46.532466 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 571/1141] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:53:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:53:48.155812 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a68563-3765-4191-87b5-32b22f8e7f54 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:48.156354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a68563-3765-4191-87b5-32b22f8e7f54 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:48.156354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a68563-3765-4191-87b5-32b22f8e7f54 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:48.157784 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 20:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:53:48.162580 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93316d6-0b80-4b35-96cf-c600e663c0c0 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:48.162980 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93316d6-0b80-4b35-96cf-c600e663c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:48.163132 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93316d6-0b80-4b35-96cf-c600e663c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:48.184767 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-f93316d6-0b80-4b35-96cf-c600e663c0c0 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:53:48.186019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-f93316d6-0b80-4b35-96cf-c600e663c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:48.193693 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 20:53:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:53:48.349685 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a68563-3765-4191-87b5-32b22f8e7f54 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:53:48.363825 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a68563-3765-4191-87b5-32b22f8e7f54 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:53:48.369431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f19a93-175d-45bc-a8ee-1d8382a6b91e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:53:48.370019 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f19a93-175d-45bc-a8ee-1d8382a6b91e service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:48.370297 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f19a93-175d-45bc-a8ee-1d8382a6b91e service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:48.370570 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f19a93-175d-45bc-a8ee-1d8382a6b91e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:48.378494 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f19a93-175d-45bc-a8ee-1d8382a6b91e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:53:48.380065 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f19a93-175d-45bc-a8ee-1d8382a6b91e service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:53:48.390785 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 572/1144] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:53:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:53:52.662254 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1d420-f076-4bf9-afd0-3107c07d4aaf None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:52.662821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1d420-f076-4bf9-afd0-3107c07d4aaf None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:52.662821 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1d420-f076-4bf9-afd0-3107c07d4aaf None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:52.664110 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:53:52.669472 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3829d-a7a1-4ace-b6fa-a4f27e4a3652 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:52.669869 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3829d-a7a1-4ace-b6fa-a4f27e4a3652 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:52.670018 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3829d-a7a1-4ace-b6fa-a4f27e4a3652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:52.689639 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-a4d3829d-a7a1-4ace-b6fa-a4f27e4a3652 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:53:52.690815 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-a4d3829d-a7a1-4ace-b6fa-a4f27e4a3652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:52.698379 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:53:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:53:53.056058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1d420-f076-4bf9-afd0-3107c07d4aaf None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:53:53.056058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-d3f1d420-f076-4bf9-afd0-3107c07d4aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:53.088446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=100 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:53.094494 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1d420-f076-4bf9-afd0-3107c07d4aaf None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:53:53.097995 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd8742-3d47-4507-9c30-4becb7c23cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:53:53.101862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd8742-3d47-4507-9c30-4becb7c23cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:53.101862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd8742-3d47-4507-9c30-4becb7c23cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:53.101862 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd8742-3d47-4507-9c30-4becb7c23cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:53.107959 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd8742-3d47-4507-9c30-4becb7c23cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:53:53.109455 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd8742-3d47-4507-9c30-4becb7c23cf1 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:53:53.118618 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 574/1147] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:53:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:53:55.491457 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be72bc7-e6aa-41a9-9253-9dc58ed4ecaf None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:55.491995 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be72bc7-e6aa-41a9-9253-9dc58ed4ecaf None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:55.491995 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be72bc7-e6aa-41a9-9253-9dc58ed4ecaf None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:55.493271 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 574/1148] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:53:55.498994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcd745-c35d-4ca8-b6d7-53dd41dd5c75 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:55.499435 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcd745-c35d-4ca8-b6d7-53dd41dd5c75 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:55.499579 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcd745-c35d-4ca8-b6d7-53dd41dd5c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:55.519344 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-4bfcd745-c35d-4ca8-b6d7-53dd41dd5c75 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:53:55.520798 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-4bfcd745-c35d-4ca8-b6d7-53dd41dd5c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:55.528525 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 575/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:53:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:53:55.866759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be72bc7-e6aa-41a9-9253-9dc58ed4ecaf None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:53:55.868464 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-2be72bc7-e6aa-41a9-9253-9dc58ed4ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:55.876024 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=54 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:55.881657 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be72bc7-e6aa-41a9-9253-9dc58ed4ecaf None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:53:55.885079 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f64007-861d-41ea-a4f4-f953381b2c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:53:55.885692 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f64007-861d-41ea-a4f4-f953381b2c18 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:55.885970 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f64007-861d-41ea-a4f4-f953381b2c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:55.886245 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f64007-861d-41ea-a4f4-f953381b2c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:55.895585 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f64007-861d-41ea-a4f4-f953381b2c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:53:55.897053 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f64007-861d-41ea-a4f4-f953381b2c18 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:53:55.906679 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 575/1150] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:53:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:53:59.894785 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a9ab-03f8-4779-aa2e-d653b7441b88 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:59.895603 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a9ab-03f8-4779-aa2e-d653b7441b88 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:59.895603 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a9ab-03f8-4779-aa2e-d653b7441b88 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:59.896916 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 576/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:53:59.902183 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d81fa-0a6d-4e5a-954f-27056d9ad267 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:53:59.902596 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d81fa-0a6d-4e5a-954f-27056d9ad267 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:53:59.902737 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d81fa-0a6d-4e5a-954f-27056d9ad267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:53:59.922225 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-784d81fa-0a6d-4e5a-954f-27056d9ad267 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:53:59.923542 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-784d81fa-0a6d-4e5a-954f-27056d9ad267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:53:59.931249 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 576/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:53:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:54:00.291981 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a9ab-03f8-4779-aa2e-d653b7441b88 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:54:00.293673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-d665a9ab-03f8-4779-aa2e-d653b7441b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:54:00.352300 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a9ab-03f8-4779-aa2e-d653b7441b88 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:54:00.355868 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08e63f-e3e6-47c1-bfbf-6a01b03651c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681cab6042a3486087c55058843deeb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:54:00.356477 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e63f-e3e6-47c1-bfbf-6a01b03651c7 service cinder] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:54:00.356753 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e63f-e3e6-47c1-bfbf-6a01b03651c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:54:00.358029 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e63f-e3e6-47c1-bfbf-6a01b03651c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:54:00.367513 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08e63f-e3e6-47c1-bfbf-6a01b03651c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:54:00.368932 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08e63f-e3e6-47c1-bfbf-6a01b03651c7 service cinder] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:54:00.379255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 577/1153] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:54:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 20:54:02.745319 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4b5f5-7025-459c-a1e1-fff448b2496d None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:54:02.745883 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4b5f5-7025-459c-a1e1-fff448b2496d None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:54:02.745883 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4b5f5-7025-459c-a1e1-fff448b2496d None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:54:02.747273 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 577/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 20:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:54:02.752544 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14cab2-0d9d-4fc5-bb30-7f17cb444db0 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:54:02.752968 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14cab2-0d9d-4fc5-bb30-7f17cb444db0 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:54:02.753242 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14cab2-0d9d-4fc5-bb30-7f17cb444db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:54:02.773015 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-5b14cab2-0d9d-4fc5-bb30-7f17cb444db0 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:54:02.774210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-5b14cab2-0d9d-4fc5-bb30-7f17cb444db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:54:02.782465 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 578/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 20:54:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:54:03.137364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4b5f5-7025-459c-a1e1-fff448b2496d None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:54:03.139305 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-74a4b5f5-7025-459c-a1e1-fff448b2496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:54:03.152542 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4b5f5-7025-459c-a1e1-fff448b2496d None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:54:03.156680 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe599b-30fb-46f3-82bc-3f9d09624e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681cab6042a3486087c55058843deeb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:54:03.157301 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe599b-30fb-46f3-82bc-3f9d09624e4a service cinder] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:54:03.157576 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe599b-30fb-46f3-82bc-3f9d09624e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:54:03.157842 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe599b-30fb-46f3-82bc-3f9d09624e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:54:03.166399 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe599b-30fb-46f3-82bc-3f9d09624e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:54:03.167822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe599b-30fb-46f3-82bc-3f9d09624e4a service cinder] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:54:03.177519 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 578/1156] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:54:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:54:12.767475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=37 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:13.173536 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=14 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:16.934894 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a93e2-97c8-4259-99a7-fdc10e3b1cbc None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:16.935537 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a93e2-97c8-4259-99a7-fdc10e3b1cbc None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:16.935537 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a93e2-97c8-4259-99a7-fdc10e3b1cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:16.951578 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104f337-7673-47ad-b465-117bfb75f709 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:16.952130 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104f337-7673-47ad-b465-117bfb75f709 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:16.952130 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104f337-7673-47ad-b465-117bfb75f709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:16.954589 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-031a93e2-97c8-4259-99a7-fdc10e3b1cbc None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:16.955797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-031a93e2-97c8-4259-99a7-fdc10e3b1cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:16.964216 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 579/1157] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:16.972009 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be40431-7c1a-4a32-992e-227211099402 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:16.981014 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-1104f337-7673-47ad-b465-117bfb75f709 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:16.981154 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be40431-7c1a-4a32-992e-227211099402 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:16.981154 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be40431-7c1a-4a32-992e-227211099402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:16.981377 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-1104f337-7673-47ad-b465-117bfb75f709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:16.981870 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 579/1158] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:55:16.990011 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b40e9-6f93-42ee-a8cd-becfead62e0f None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:16.990303 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b40e9-6f93-42ee-a8cd-becfead62e0f None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:16.990582 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b40e9-6f93-42ee-a8cd-becfead62e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:16.992586 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-3be40431-7c1a-4a32-992e-227211099402 None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:16.993798 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-3be40431-7c1a-4a32-992e-227211099402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:17.001394 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 580/1159] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:55:17.005782 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be40431-7c1a-4a32-992e-227211099402 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.010752 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-bd3b40e9-6f93-42ee-a8cd-becfead62e0f None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:17.015441 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-bd3b40e9-6f93-42ee-a8cd-becfead62e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:17.015556 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be40431-7c1a-4a32-992e-227211099402 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.019554 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a07dc-e754-4b91-9925-d6413c2ad132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.019955 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 580/1160] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:55:17.020134 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a07dc-e754-4b91-9925-d6413c2ad132 admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.020407 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a07dc-e754-4b91-9925-d6413c2ad132 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.020673 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a07dc-e754-4b91-9925-d6413c2ad132 admin admin] PATH_INFO: `/v3/domains` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.021333 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a07dc-e754-4b91-9925-d6413c2ad132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=100114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:55:17.021631 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a07dc-e754-4b91-9925-d6413c2ad132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.023767 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a07dc-e754-4b91-9925-d6413c2ad132 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.025141 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b40e9-6f93-42ee-a8cd-becfead62e0f None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.034531 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b40e9-6f93-42ee-a8cd-becfead62e0f None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.043139 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 581/1161] 10.222.0.52 () {58 vars in 1153 bytes} [Sat Sep 17 20:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:55:17.043321 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.043321 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.043321 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.043321 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] PATH_INFO: `/v3/domains` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.043682 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=100115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 20:55:17.043682 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.043682 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WARNING py.warnings [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:55:17.043682 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: warnings.warn(msg) Sep 17 20:55:17.043682 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: Sep 17 20:55:17.043682 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.045701 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a07dc-e754-4b91-9925-d6413c2ad132 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.060961 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 581/1162] 10.222.0.52 () {58 vars in 1153 bytes} [Sat Sep 17 20:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 20:55:17.061210 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a07dc-e754-4b91-9925-d6413c2ad132 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.061521 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f7c22-f466-43f5-abbf-ffa27ab9e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.062109 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f7c22-f466-43f5-abbf-ffa27ab9e90c admin admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.062385 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f7c22-f466-43f5-abbf-ffa27ab9e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.062656 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f7c22-f466-43f5-abbf-ffa27ab9e90c admin admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.062860 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.063456 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f7c22-f466-43f5-abbf-ffa27ab9e90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.064459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WARNING py.warnings [None req-aa1f7c22-f466-43f5-abbf-ffa27ab9e90c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:55:17.064459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: warnings.warn(msg) Sep 17 20:55:17.064459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: Sep 17 20:55:17.065686 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f7c22-f466-43f5-abbf-ffa27ab9e90c admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.073425 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246f65c-5a8d-431d-b34e-c6fc63ec7925 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.077989 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a86a6-4c65-4d00-8e96-434e5f36b153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.078572 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a86a6-4c65-4d00-8e96-434e5f36b153 admin admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.078848 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a86a6-4c65-4d00-8e96-434e5f36b153 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.079118 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a86a6-4c65-4d00-8e96-434e5f36b153 admin admin] PATH_INFO: `/v3/projects` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.079733 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a86a6-4c65-4d00-8e96-434e5f36b153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.081709 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a86a6-4c65-4d00-8e96-434e5f36b153 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.163755 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 582/1163] 10.222.0.52 () {60 vars in 1153 bytes} [Sat Sep 17 20:55:17 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:55:17.167783 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f7c22-f466-43f5-abbf-ffa27ab9e90c admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.207821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 582/1164] 10.222.0.52 () {60 vars in 1153 bytes} [Sat Sep 17 20:55:17 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:55:17.212701 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a86a6-4c65-4d00-8e96-434e5f36b153 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.229482 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f7c22-f466-43f5-abbf-ffa27ab9e90c admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.275989 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a86a6-4c65-4d00-8e96-434e5f36b153 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.281063 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaa7e7-7203-4ace-b59f-5becf84da2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.281758 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaa7e7-7203-4ace-b59f-5becf84da2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.282033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaa7e7-7203-4ace-b59f-5becf84da2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.282298 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaa7e7-7203-4ace-b59f-5becf84da2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.282913 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deaa7e7-7203-4ace-b59f-5becf84da2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.283920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WARNING py.warnings [None req-1deaa7e7-7203-4ace-b59f-5becf84da2d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:55:17.283920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: warnings.warn(msg) Sep 17 20:55:17.283920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: Sep 17 20:55:17.285186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deaa7e7-7203-4ace-b59f-5becf84da2d1 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.289425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebc3a7-e1af-4743-b923-b766d91e56de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.290066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc3a7-e1af-4743-b923-b766d91e56de admin admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.290342 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc3a7-e1af-4743-b923-b766d91e56de admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.290631 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc3a7-e1af-4743-b923-b766d91e56de admin admin] PATH_INFO: `/v3/users` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.291232 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebc3a7-e1af-4743-b923-b766d91e56de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.293267 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebc3a7-e1af-4743-b923-b766d91e56de admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.390650 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 583/1165] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:55:17 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:55:17.394776 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaa7e7-7203-4ace-b59f-5becf84da2d1 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.405203 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaa7e7-7203-4ace-b59f-5becf84da2d1 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.410405 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a43148-ffb3-415f-8480-18a169638fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.422513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a43148-ffb3-415f-8480-18a169638fea admin admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.422513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a43148-ffb3-415f-8480-18a169638fea admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.422513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a43148-ffb3-415f-8480-18a169638fea admin admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.422513 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a43148-ffb3-415f-8480-18a169638fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.422922 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 583/1166] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:55:17 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:55:17.423020 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a43148-ffb3-415f-8480-18a169638fea admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.423498 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebc3a7-e1af-4743-b923-b766d91e56de admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.426422 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 584/1167] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 20:55:17.430731 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a43148-ffb3-415f-8480-18a169638fea admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.434550 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebc3a7-e1af-4743-b923-b766d91e56de admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.440834 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a72931-13fc-4536-90e8-331ae87c6411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.443765 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a72931-13fc-4536-90e8-331ae87c6411 admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.443765 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a72931-13fc-4536-90e8-331ae87c6411 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.443765 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a72931-13fc-4536-90e8-331ae87c6411 admin admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.443765 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a72931-13fc-4536-90e8-331ae87c6411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.445122 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a72931-13fc-4536-90e8-331ae87c6411 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.447899 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a43148-ffb3-415f-8480-18a169638fea admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.453862 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e5e47-ce37-45b8-b7b5-fac92d54850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.456360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e5e47-ce37-45b8-b7b5-fac92d54850c admin admin] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.456360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e5e47-ce37-45b8-b7b5-fac92d54850c admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.456360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e5e47-ce37-45b8-b7b5-fac92d54850c admin admin] PATH_INFO: `/v3/roles` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.456360 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e5e47-ce37-45b8-b7b5-fac92d54850c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.457197 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 584/1168] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 20:55:17.457357 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e5e47-ce37-45b8-b7b5-fac92d54850c admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.461726 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a72931-13fc-4536-90e8-331ae87c6411 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.470880 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 585/1169] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 20:55:17.471282 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a72931-13fc-4536-90e8-331ae87c6411 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.474217 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e5e47-ce37-45b8-b7b5-fac92d54850c admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.476100 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35121172-ac19-465a-8600-b37e374e7469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.476681 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35121172-ac19-465a-8600-b37e374e7469 admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.476953 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35121172-ac19-465a-8600-b37e374e7469 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.477252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35121172-ac19-465a-8600-b37e374e7469 admin admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.477874 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35121172-ac19-465a-8600-b37e374e7469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.479461 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35121172-ac19-465a-8600-b37e374e7469 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.483920 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e5e47-ce37-45b8-b7b5-fac92d54850c admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.488474 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aba12-2607-40b4-bfd5-0ba1956a61d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.489157 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aba12-2607-40b4-bfd5-0ba1956a61d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.489469 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aba12-2607-40b4-bfd5-0ba1956a61d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.489741 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aba12-2607-40b4-bfd5-0ba1956a61d0 admin admin] PATH_INFO: `/v3/projects/c75ebf2c145b463699596d41d903c29e/users/940dd496b2b5409a9f80c97963060787/roles/dc25b689a7f8405a807147fca4ae3d0b` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.490184 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 585/1170] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 20:55:17.498091 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35121172-ac19-465a-8600-b37e374e7469 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.504880 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aba12-2607-40b4-bfd5-0ba1956a61d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75ebf2c145b463699596d41d903c29e, user_id=940dd496b2b5409a9f80c97963060787, role_id=dc25b689a7f8405a807147fca4ae3d0b)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.508116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35121172-ac19-465a-8600-b37e374e7469 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.508408 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aba12-2607-40b4-bfd5-0ba1956a61d0 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.513287 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36669ace-e46b-4992-8272-44df808adbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.514606 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36669ace-e46b-4992-8272-44df808adbc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.514917 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36669ace-e46b-4992-8272-44df808adbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.515173 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36669ace-e46b-4992-8272-44df808adbc5 admin admin] PATH_INFO: `/v3/projects/0fa97092b299480c8e707503ffaf79e1/users/56947fbba8cc440fbd8ecc3bd1c9f73f/roles/dc25b689a7f8405a807147fca4ae3d0b` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.530533 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36669ace-e46b-4992-8272-44df808adbc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa97092b299480c8e707503ffaf79e1, user_id=56947fbba8cc440fbd8ecc3bd1c9f73f, role_id=dc25b689a7f8405a807147fca4ae3d0b)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.531549 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WARNING py.warnings [None req-36669ace-e46b-4992-8272-44df808adbc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 20:55:17.531549 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: warnings.warn(msg) Sep 17 20:55:17.531549 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: Sep 17 20:55:17.533696 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36669ace-e46b-4992-8272-44df808adbc5 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.606761 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 586/1171] 10.222.0.52 () {60 vars in 1483 bytes} [Sat Sep 17 20:55:17 2022] PUT /identity/v3/projects/c75ebf2c145b463699596d41d903c29e/users/940dd496b2b5409a9f80c97963060787/roles/dc25b689a7f8405a807147fca4ae3d0b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 20:55:17.611851 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909ab1d-c366-48ae-af41-ec7cbe30460c None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.612132 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909ab1d-c366-48ae-af41-ec7cbe30460c None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.612413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909ab1d-c366-48ae-af41-ec7cbe30460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.632878 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d909ab1d-c366-48ae-af41-ec7cbe30460c None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:17.634186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d909ab1d-c366-48ae-af41-ec7cbe30460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:17.642070 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 586/1172] 10.222.0.52 () {60 vars in 1483 bytes} [Sat Sep 17 20:55:17 2022] PUT /identity/v3/projects/0fa97092b299480c8e707503ffaf79e1/users/56947fbba8cc440fbd8ecc3bd1c9f73f/roles/dc25b689a7f8405a807147fca4ae3d0b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:55:17.647271 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d9bb0-58e8-42ce-b068-a106b9e51c9d None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.647649 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d9bb0-58e8-42ce-b068-a106b9e51c9d None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.647921 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d9bb0-58e8-42ce-b068-a106b9e51c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.655252 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:17.667948 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-cb0d9bb0-58e8-42ce-b068-a106b9e51c9d None None] MFA Rules not processed for user `c1b97854cfd447a990a1e65cc1830977`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:17.669220 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-cb0d9bb0-58e8-42ce-b068-a106b9e51c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:17.682639 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:17.696909 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 587/1173] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:55:17.707240 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909ab1d-c366-48ae-af41-ec7cbe30460c None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.729826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 587/1174] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:55:17.739686 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d9bb0-58e8-42ce-b068-a106b9e51c9d None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:17.771406 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909ab1d-c366-48ae-af41-ec7cbe30460c None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.775078 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fbcfe-1b5a-429e-a790-45bbd071ba2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.775678 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fbcfe-1b5a-429e-a790-45bbd071ba2c service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.775960 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fbcfe-1b5a-429e-a790-45bbd071ba2c service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.776218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fbcfe-1b5a-429e-a790-45bbd071ba2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.785987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fbcfe-1b5a-429e-a790-45bbd071ba2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.788476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fbcfe-1b5a-429e-a790-45bbd071ba2c service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.797664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 588/1175] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 20:55:17.799912 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d9bb0-58e8-42ce-b068-a106b9e51c9d None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:17.803534 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d265065-e1ac-4bea-baee-389a0c28870e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:17.805302 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d265065-e1ac-4bea-baee-389a0c28870e service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:17.805581 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d265065-e1ac-4bea-baee-389a0c28870e service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:17.805855 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d265065-e1ac-4bea-baee-389a0c28870e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:17.820785 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d265065-e1ac-4bea-baee-389a0c28870e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:17.822262 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d265065-e1ac-4bea-baee-389a0c28870e service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:17.831708 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 588/1176] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 20:55:23.784290 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fda34f-3e9d-48b6-8962-7619f615d629 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:23.785335 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fda34f-3e9d-48b6-8962-7619f615d629 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:23.785762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fda34f-3e9d-48b6-8962-7619f615d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:23.847698 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-63fda34f-3e9d-48b6-8962-7619f615d629 None None] MFA Rules not processed for user `56947fbba8cc440fbd8ecc3bd1c9f73f`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:23.848954 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-63fda34f-3e9d-48b6-8962-7619f615d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:23.946624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 589/1177] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:23 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 20:55:23.952655 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d265065-e1ac-4bea-baee-389a0c28870e service neutron] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:23.963517 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d265065-e1ac-4bea-baee-389a0c28870e service neutron] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:23.969218 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4795-d842-4606-89cc-562254f43e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:23.970078 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4795-d842-4606-89cc-562254f43e68 admin admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:23.970359 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4795-d842-4606-89cc-562254f43e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:23.970768 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4795-d842-4606-89cc-562254f43e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:23.971501 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f4795-d842-4606-89cc-562254f43e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:23.974160 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f4795-d842-4606-89cc-562254f43e68 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:24.124847 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 589/1178] 10.222.0.52 () {60 vars in 1153 bytes} [Sat Sep 17 20:55:23 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:55:24.128936 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fda34f-3e9d-48b6-8962-7619f615d629 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:24.148908 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fda34f-3e9d-48b6-8962-7619f615d629 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:24.243247 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce8446-6b18-43e5-be49-d58804679198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:24.243917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce8446-6b18-43e5-be49-d58804679198 admin admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:24.244189 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce8446-6b18-43e5-be49-d58804679198 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:24.244464 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce8446-6b18-43e5-be49-d58804679198 admin admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:24.245101 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce8446-6b18-43e5-be49-d58804679198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:24.247476 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce8446-6b18-43e5-be49-d58804679198 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:24.356379 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 590/1179] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:55:24 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:55:24.366647 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4795-d842-4606-89cc-562254f43e68 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:24.373495 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4795-d842-4606-89cc-562254f43e68 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:24.389306 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b265d2-f34f-4fc7-aaa4-6cccc7dc957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:24.391288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b265d2-f34f-4fc7-aaa4-6cccc7dc957a admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:24.391288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b265d2-f34f-4fc7-aaa4-6cccc7dc957a admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:24.391288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b265d2-f34f-4fc7-aaa4-6cccc7dc957a admin admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:24.391288 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b265d2-f34f-4fc7-aaa4-6cccc7dc957a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:24.409568 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b265d2-f34f-4fc7-aaa4-6cccc7dc957a admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:24.436123 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 590/1180] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:55:24.438271 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce8446-6b18-43e5-be49-d58804679198 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:24.453845 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce8446-6b18-43e5-be49-d58804679198 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:24.461111 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e30483-10b8-472a-ad8f-e2335d82f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:24.461759 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e30483-10b8-472a-ad8f-e2335d82f798 admin admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:24.462207 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e30483-10b8-472a-ad8f-e2335d82f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:24.462484 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e30483-10b8-472a-ad8f-e2335d82f798 admin admin] PATH_INFO: `/v3/projects/32b8bdc6df7647709a77962d2118fb8f/users/284fc44c0bfc4134bf2d894cc779a745/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:24.483446 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e30483-10b8-472a-ad8f-e2335d82f798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b8bdc6df7647709a77962d2118fb8f, user_id=284fc44c0bfc4134bf2d894cc779a745, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:24.486567 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e30483-10b8-472a-ad8f-e2335d82f798 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:24.490285 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:24.604070 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 591/1181] 10.222.0.52 () {60 vars in 1483 bytes} [Sat Sep 17 20:55:24 2022] PUT /identity/v3/projects/32b8bdc6df7647709a77962d2118fb8f/users/284fc44c0bfc4134bf2d894cc779a745/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:55:24.605005 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b265d2-f34f-4fc7-aaa4-6cccc7dc957a admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:24.615731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b265d2-f34f-4fc7-aaa4-6cccc7dc957a admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:24.693270 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a0534-d739-4089-8308-0b3996ec9a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:24.693870 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a0534-d739-4089-8308-0b3996ec9a2e admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:24.694150 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a0534-d739-4089-8308-0b3996ec9a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:24.694428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a0534-d739-4089-8308-0b3996ec9a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:24.695124 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a0534-d739-4089-8308-0b3996ec9a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:24.696731 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a0534-d739-4089-8308-0b3996ec9a2e admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:24.707008 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d96328-ffba-45a6-94ae-0a1f450f7bce None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:24.707332 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d96328-ffba-45a6-94ae-0a1f450f7bce None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:24.707559 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d96328-ffba-45a6-94ae-0a1f450f7bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:24.707899 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 591/1182] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:55:24.711690 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a0534-d739-4089-8308-0b3996ec9a2e admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:24.724728 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a0534-d739-4089-8308-0b3996ec9a2e admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:24.731321 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e248-7564-4144-8704-1bf37c85150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:24.732006 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e248-7564-4144-8704-1bf37c85150a admin admin] REQUEST_METHOD: `PUT` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:24.732282 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e248-7564-4144-8704-1bf37c85150a admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:24.732564 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e248-7564-4144-8704-1bf37c85150a admin admin] PATH_INFO: `/v3/projects/32b8bdc6df7647709a77962d2118fb8f/users/284fc44c0bfc4134bf2d894cc779a745/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:24.734663 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2e248-7564-4144-8704-1bf37c85150a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b8bdc6df7647709a77962d2118fb8f, user_id=284fc44c0bfc4134bf2d894cc779a745, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:24.739325 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2e248-7564-4144-8704-1bf37c85150a admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:24.744069 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d8d96328-ffba-45a6-94ae-0a1f450f7bce None None] MFA Rules not processed for user `940dd496b2b5409a9f80c97963060787`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:24.744459 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:24.745317 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d8d96328-ffba-45a6-94ae-0a1f450f7bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:24.753780 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 592/1183] 10.222.0.52 () {60 vars in 1483 bytes} [Sat Sep 17 20:55:24 2022] PUT /identity/v3/projects/32b8bdc6df7647709a77962d2118fb8f/users/284fc44c0bfc4134bf2d894cc779a745/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 20:55:24.829364 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 592/1184] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:24 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:24.834020 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e248-7564-4144-8704-1bf37c85150a admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:24.914688 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e248-7564-4144-8704-1bf37c85150a admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:24.919745 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba1835-672b-4133-ae6c-fe4a5ba71ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:24.920908 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1835-672b-4133-ae6c-fe4a5ba71ffb admin admin] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:24.921217 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1835-672b-4133-ae6c-fe4a5ba71ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:24.921518 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1835-672b-4133-ae6c-fe4a5ba71ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:24.922161 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba1835-672b-4133-ae6c-fe4a5ba71ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:24.924058 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba1835-672b-4133-ae6c-fe4a5ba71ffb admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:25.063423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 593/1185] 10.222.0.52 () {60 vars in 1153 bytes} [Sat Sep 17 20:55:24 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 20:55:25.071737 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d96328-ffba-45a6-94ae-0a1f450f7bce None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:25.085931 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d96328-ffba-45a6-94ae-0a1f450f7bce None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436699be-a9c9-49bd-b5da-bd04b0beb1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:25.187724 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436699be-a9c9-49bd-b5da-bd04b0beb1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:25.188482 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436699be-a9c9-49bd-b5da-bd04b0beb1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:25.188860 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436699be-a9c9-49bd-b5da-bd04b0beb1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:25.190344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436699be-a9c9-49bd-b5da-bd04b0beb1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:25.195315 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436699be-a9c9-49bd-b5da-bd04b0beb1c2 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:25.276075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 593/1186] 10.222.0.52 () {60 vars in 1144 bytes} [Sat Sep 17 20:55:25 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 20:55:25.280577 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba1835-672b-4133-ae6c-fe4a5ba71ffb admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:25.292887 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba1835-672b-4133-ae6c-fe4a5ba71ffb admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:25.298523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21012809-139f-40ec-8a1c-e66e17f30425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:25.299339 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21012809-139f-40ec-8a1c-e66e17f30425 admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:25.299833 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21012809-139f-40ec-8a1c-e66e17f30425 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:25.300298 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21012809-139f-40ec-8a1c-e66e17f30425 admin admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:25.302497 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21012809-139f-40ec-8a1c-e66e17f30425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:25.306055 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21012809-139f-40ec-8a1c-e66e17f30425 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:25.329206 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 594/1187] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 20:55:25.332510 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436699be-a9c9-49bd-b5da-bd04b0beb1c2 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:25.343354 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436699be-a9c9-49bd-b5da-bd04b0beb1c2 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:25.348858 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041b67e-5d97-405c-9ed3-abae83b8be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:25.349929 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041b67e-5d97-405c-9ed3-abae83b8be5c admin admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:25.350292 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041b67e-5d97-405c-9ed3-abae83b8be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:25.353571 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041b67e-5d97-405c-9ed3-abae83b8be5c admin admin] PATH_INFO: `/v3/projects/8cda79df9c344d24b7a8a14f506614cc/users/82b2d4945b684e25952440b903d2537a/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:25.369315 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041b67e-5d97-405c-9ed3-abae83b8be5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cda79df9c344d24b7a8a14f506614cc, user_id=82b2d4945b684e25952440b903d2537a, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:25.373718 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041b67e-5d97-405c-9ed3-abae83b8be5c admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:25.460484 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 594/1188] 10.222.0.52 () {60 vars in 1483 bytes} [Sat Sep 17 20:55:25 2022] PUT /identity/v3/projects/8cda79df9c344d24b7a8a14f506614cc/users/82b2d4945b684e25952440b903d2537a/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:55:25.470776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21012809-139f-40ec-8a1c-e66e17f30425 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:25.488256 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21012809-139f-40ec-8a1c-e66e17f30425 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:25.564587 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e161a-20aa-40b0-89d9-443f42547261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:25.565239 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e161a-20aa-40b0-89d9-443f42547261 admin admin] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:25.565523 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e161a-20aa-40b0-89d9-443f42547261 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:25.565798 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e161a-20aa-40b0-89d9-443f42547261 admin admin] PATH_INFO: `/v3/roles` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:25.566444 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e161a-20aa-40b0-89d9-443f42547261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:25.568066 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e161a-20aa-40b0-89d9-443f42547261 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:25.580665 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 595/1189] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 17 20:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 20:55:25.585004 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041b67e-5d97-405c-9ed3-abae83b8be5c admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:25.599097 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041b67e-5d97-405c-9ed3-abae83b8be5c admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:25.612342 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae853f-f95a-44e6-8955-92a9ac72dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:25.613242 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae853f-f95a-44e6-8955-92a9ac72dd40 admin admin] REQUEST_METHOD: `PUT` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:25.613736 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae853f-f95a-44e6-8955-92a9ac72dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:25.614120 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae853f-f95a-44e6-8955-92a9ac72dd40 admin admin] PATH_INFO: `/v3/projects/8cda79df9c344d24b7a8a14f506614cc/users/82b2d4945b684e25952440b903d2537a/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:25.616275 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae853f-f95a-44e6-8955-92a9ac72dd40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cda79df9c344d24b7a8a14f506614cc, user_id=82b2d4945b684e25952440b903d2537a, role_id=b9e6d93cc2ff4ff6b6787c36aa52b75a)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:25.628058 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae853f-f95a-44e6-8955-92a9ac72dd40 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:25.641970 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 595/1190] 10.222.0.52 () {60 vars in 1483 bytes} [Sat Sep 17 20:55:25 2022] PUT /identity/v3/projects/8cda79df9c344d24b7a8a14f506614cc/users/82b2d4945b684e25952440b903d2537a/roles/b9e6d93cc2ff4ff6b6787c36aa52b75a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 20:55:31.669426 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258de482-24a4-4d0e-aa18-5b9ebb383ba6 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:31.670257 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258de482-24a4-4d0e-aa18-5b9ebb383ba6 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:31.670682 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258de482-24a4-4d0e-aa18-5b9ebb383ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:31.742897 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-258de482-24a4-4d0e-aa18-5b9ebb383ba6 None None] MFA Rules not processed for user `284fc44c0bfc4134bf2d894cc779a745`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:31.744393 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-258de482-24a4-4d0e-aa18-5b9ebb383ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:31.826932 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:31.855306 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 596/1191] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:31 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:31.873539 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae853f-f95a-44e6-8955-92a9ac72dd40 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:31.876000 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-39ae853f-f95a-44e6-8955-92a9ac72dd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:31.937707 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:31.971926 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae853f-f95a-44e6-8955-92a9ac72dd40 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:31.978302 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c43841-b1df-4dfc-a040-e8f4e92f1ee8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8200d2f30fa47dc9799dfa26a81109a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:31.979983 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43841-b1df-4dfc-a040-e8f4e92f1ee8 service glance] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:31.980419 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43841-b1df-4dfc-a040-e8f4e92f1ee8 service glance] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:31.981002 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43841-b1df-4dfc-a040-e8f4e92f1ee8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:32.058038 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c43841-b1df-4dfc-a040-e8f4e92f1ee8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:32.060166 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c43841-b1df-4dfc-a040-e8f4e92f1ee8 service glance] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:32.077661 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 596/1192] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:31 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:55:33.217953 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11cb0e-f2c6-42db-a780-76a976ae1a94 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:33.218355 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11cb0e-f2c6-42db-a780-76a976ae1a94 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:33.218498 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11cb0e-f2c6-42db-a780-76a976ae1a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:33.254425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-9d11cb0e-f2c6-42db-a780-76a976ae1a94 None None] MFA Rules not processed for user `82b2d4945b684e25952440b903d2537a`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:33.255695 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-9d11cb0e-f2c6-42db-a780-76a976ae1a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:33.401259 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 597/1193] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:33 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:33.422042 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c43841-b1df-4dfc-a040-e8f4e92f1ee8 service glance] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:33.431397 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c43841-b1df-4dfc-a040-e8f4e92f1ee8 service glance] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:33.435538 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20606de2-4534-4034-aff5-47ecaacab430 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8200d2f30fa47dc9799dfa26a81109a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:33.436139 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20606de2-4534-4034-aff5-47ecaacab430 service glance] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:33.436427 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20606de2-4534-4034-aff5-47ecaacab430 service glance] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:33.436853 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20606de2-4534-4034-aff5-47ecaacab430 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:33.509835 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20606de2-4534-4034-aff5-47ecaacab430 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:33.511659 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20606de2-4534-4034-aff5-47ecaacab430 service glance] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:33.522430 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 597/1194] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:33 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:55:43.369903 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=38 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:43.485042 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2102131-5aa3-4ac7-9ed3-f7d0a7aae2d3 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:43.485370 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2102131-5aa3-4ac7-9ed3-f7d0a7aae2d3 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:43.485643 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2102131-5aa3-4ac7-9ed3-f7d0a7aae2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:43.505013 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-f2102131-5aa3-4ac7-9ed3-f7d0a7aae2d3 None None] MFA Rules not processed for user `940dd496b2b5409a9f80c97963060787`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:43.506248 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-f2102131-5aa3-4ac7-9ed3-f7d0a7aae2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:43.513643 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 598/1195] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:55:43 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:43.517937 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=60 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:43.815558 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ac53e-b051-4692-bd31-cd727717a470 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:43.816822 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ac53e-b051-4692-bd31-cd727717a470 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:43.817402 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ac53e-b051-4692-bd31-cd727717a470 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:43.818901 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 598/1196] 10.222.0.52 () {54 vars in 965 bytes} [Sat Sep 17 20:55:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:55:43.825344 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c741b2a-14dc-4c8a-97cd-919a80df5c57 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:43.829244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c741b2a-14dc-4c8a-97cd-919a80df5c57 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:43.829244 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c741b2a-14dc-4c8a-97cd-919a80df5c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:43.846605 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-3c741b2a-14dc-4c8a-97cd-919a80df5c57 None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:43.847828 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-3c741b2a-14dc-4c8a-97cd-919a80df5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:43.913103 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 599/1197] 10.222.0.52 () {58 vars in 1062 bytes} [Sat Sep 17 20:55:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:43.919162 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2a54-7d62-4c72-aac9-efedf89c50e0 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:43.921344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2a54-7d62-4c72-aac9-efedf89c50e0 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:43.921344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2a54-7d62-4c72-aac9-efedf89c50e0 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:43.921344 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 599/1198] 10.222.0.52 () {54 vars in 912 bytes} [Sat Sep 17 20:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:55:43.926059 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6b4f-09b6-4808-b444-81787bef03a5 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:43.926350 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6b4f-09b6-4808-b444-81787bef03a5 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:43.926625 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6b4f-09b6-4808-b444-81787bef03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:43.947261 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-57ad6b4f-09b6-4808-b444-81787bef03a5 None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:43.948479 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-57ad6b4f-09b6-4808-b444-81787bef03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:43.957766 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 600/1199] 10.222.0.52 () {58 vars in 1009 bytes} [Sat Sep 17 20:55:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:43.970342 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2a54-7d62-4c72-aac9-efedf89c50e0 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:43.972176 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-41cf2a54-7d62-4c72-aac9-efedf89c50e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:43.986117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2a54-7d62-4c72-aac9-efedf89c50e0 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:43.989717 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82030522-15f1-46c9-ab72-30ab41c10d1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8200d2f30fa47dc9799dfa26a81109a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:43.990363 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82030522-15f1-46c9-ab72-30ab41c10d1f service glance] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:43.990579 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82030522-15f1-46c9-ab72-30ab41c10d1f service glance] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:43.990854 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82030522-15f1-46c9-ab72-30ab41c10d1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:44.001443 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82030522-15f1-46c9-ab72-30ab41c10d1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:44.002911 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82030522-15f1-46c9-ab72-30ab41c10d1f service glance] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:44.017211 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 600/1200] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:55:44.374538 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfca0-a03a-4680-b81c-ea2df3714adc None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:44.375101 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfca0-a03a-4680-b81c-ea2df3714adc None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:44.375101 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfca0-a03a-4680-b81c-ea2df3714adc None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:44.376418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 601/1201] 10.222.0.52 () {54 vars in 912 bytes} [Sat Sep 17 20:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:55:44.381616 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315200c-8bfe-4205-b622-28f038cd23b3 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:44.381905 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315200c-8bfe-4205-b622-28f038cd23b3 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:44.382179 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315200c-8bfe-4205-b622-28f038cd23b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:44.402401 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-e315200c-8bfe-4205-b622-28f038cd23b3 None None] MFA Rules not processed for user `ca8186a27e64434f92b8bba23558cf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:44.404013 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-e315200c-8bfe-4205-b622-28f038cd23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:44.457824 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 601/1202] 10.222.0.52 () {58 vars in 1009 bytes} [Sat Sep 17 20:55:44 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:44.468494 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dfca0-a03a-4680-b81c-ea2df3714adc None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:44.481354 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dfca0-a03a-4680-b81c-ea2df3714adc None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:44.485924 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cae75c-7498-46ba-b97b-a0bee1bb68ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:44.486842 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cae75c-7498-46ba-b97b-a0bee1bb68ea service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:44.487123 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cae75c-7498-46ba-b97b-a0bee1bb68ea service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:44.487435 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cae75c-7498-46ba-b97b-a0bee1bb68ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:44.496719 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cae75c-7498-46ba-b97b-a0bee1bb68ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:44.498151 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cae75c-7498-46ba-b97b-a0bee1bb68ea service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:44.506221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 602/1203] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:44 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:55:45.127166 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a925b-db3a-4e1b-963b-6ae63d56a9e5 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:45.127727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a925b-db3a-4e1b-963b-6ae63d56a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:45.127727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a925b-db3a-4e1b-963b-6ae63d56a9e5 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:45.129267 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 602/1204] 10.222.0.52 () {54 vars in 965 bytes} [Sat Sep 17 20:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:55:45.135358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bed43-a038-4392-8d06-33dbfb1fb909 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:45.135652 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bed43-a038-4392-8d06-33dbfb1fb909 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:45.136002 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bed43-a038-4392-8d06-33dbfb1fb909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:45.155757 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a925b-db3a-4e1b-963b-6ae63d56a9e5 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:45.160050 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-fe6bed43-a038-4392-8d06-33dbfb1fb909 None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:45.161283 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-fe6bed43-a038-4392-8d06-33dbfb1fb909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:45.170344 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 603/1205] 10.222.0.52 () {58 vars in 1062 bytes} [Sat Sep 17 20:55:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:45.175783 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed50c2-d8dc-4a74-9ab6-f5775120f473 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:45.176064 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed50c2-d8dc-4a74-9ab6-f5775120f473 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:45.176345 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed50c2-d8dc-4a74-9ab6-f5775120f473 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:45.177776 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 604/1206] 10.222.0.52 () {54 vars in 912 bytes} [Sat Sep 17 20:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 20:55:45.182938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d826908-40c4-4e2a-ab5a-0525bc3e38c3 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:45.183358 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d826908-40c4-4e2a-ab5a-0525bc3e38c3 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:45.183636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d826908-40c4-4e2a-ab5a-0525bc3e38c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:45.204320 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-1d826908-40c4-4e2a-ab5a-0525bc3e38c3 None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:45.205596 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-1d826908-40c4-4e2a-ab5a-0525bc3e38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:45.216661 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 605/1207] 10.222.0.52 () {58 vars in 1009 bytes} [Sat Sep 17 20:55:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:45.227540 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d826908-40c4-4e2a-ab5a-0525bc3e38c3 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:45.237321 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d826908-40c4-4e2a-ab5a-0525bc3e38c3 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:45.241994 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bd3ef-dd83-4d21-b330-d2c9f9044e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:45.242596 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bd3ef-dd83-4d21-b330-d2c9f9044e94 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:45.243840 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bd3ef-dd83-4d21-b330-d2c9f9044e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:45.244115 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bd3ef-dd83-4d21-b330-d2c9f9044e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:45.245655 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a925b-db3a-4e1b-963b-6ae63d56a9e5 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:45.252433 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcdf18-c6f6-4e40-91bc-ab42fde39a03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88caaed0c8c4438ea57d2f313fcf287a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:45.253121 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcdf18-c6f6-4e40-91bc-ab42fde39a03 service placement] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:45.253352 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcdf18-c6f6-4e40-91bc-ab42fde39a03 service placement] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:45.253626 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcdf18-c6f6-4e40-91bc-ab42fde39a03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:45.253814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bd3ef-dd83-4d21-b330-d2c9f9044e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:45.255992 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bd3ef-dd83-4d21-b330-d2c9f9044e94 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:45.256137 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-e1dcdf18-c6f6-4e40-91bc-ab42fde39a03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:45.266616 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 606/1208] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 20:55:45.276446 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcdf18-c6f6-4e40-91bc-ab42fde39a03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:45.278188 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcdf18-c6f6-4e40-91bc-ab42fde39a03 service placement] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:45.293202 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 603/1209] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:55:55.261576 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=53 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:55.287090 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=61 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:58.305823 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36f5f1-fa70-49b0-932c-719ec20ec3ec None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:58.306956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36f5f1-fa70-49b0-932c-719ec20ec3ec None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:58.306956 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36f5f1-fa70-49b0-932c-719ec20ec3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:58.346420 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-7a36f5f1-fa70-49b0-932c-719ec20ec3ec None None] MFA Rules not processed for user `ca8186a27e64434f92b8bba23558cf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:58.347902 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-7a36f5f1-fa70-49b0-932c-719ec20ec3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:58.361369 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 607/1210] 10.222.0.27 () {58 vars in 1015 bytes} [Sat Sep 17 20:55:58 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:58.375486 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcdf18-c6f6-4e40-91bc-ab42fde39a03 service placement] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:58.388635 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcdf18-c6f6-4e40-91bc-ab42fde39a03 service placement] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:58.392441 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fdca6-f972-4cc1-be9a-11ea49dff757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:58.393256 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fdca6-f972-4cc1-be9a-11ea49dff757 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:58.393748 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fdca6-f972-4cc1-be9a-11ea49dff757 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:58.394027 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fdca6-f972-4cc1-be9a-11ea49dff757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:58.402787 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fdca6-f972-4cc1-be9a-11ea49dff757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:58.404867 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fdca6-f972-4cc1-be9a-11ea49dff757 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:58.413795 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 604/1211] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:58 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:55:59.519855 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed79561-28ef-45f1-bd64-5253563ee402 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:59.520418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed79561-28ef-45f1-bd64-5253563ee402 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:59.520418 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed79561-28ef-45f1-bd64-5253563ee402 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:59.522119 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 608/1212] 10.222.0.52 () {54 vars in 921 bytes} [Sat Sep 17 20:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:55:59.542955 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553bb6-48ca-42ee-8416-350d0a5f2f01 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:59.543540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553bb6-48ca-42ee-8416-350d0a5f2f01 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:59.543540 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553bb6-48ca-42ee-8416-350d0a5f2f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:59.568298 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-48553bb6-48ca-42ee-8416-350d0a5f2f01 None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:55:59.569551 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-48553bb6-48ca-42ee-8416-350d0a5f2f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:55:59.579428 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 605/1213] 10.222.0.52 () {58 vars in 1018 bytes} [Sat Sep 17 20:55:59 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:55:59.597649 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed79561-28ef-45f1-bd64-5253563ee402 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:55:59.614938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed79561-28ef-45f1-bd64-5253563ee402 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:55:59.621219 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3c8da-39a4-4804-a4e3-0f8b824ccf26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:55:59.621833 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3c8da-39a4-4804-a4e3-0f8b824ccf26 service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:55:59.622114 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3c8da-39a4-4804-a4e3-0f8b824ccf26 service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:55:59.622387 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3c8da-39a4-4804-a4e3-0f8b824ccf26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:55:59.631319 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3c8da-39a4-4804-a4e3-0f8b824ccf26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:55:59.632928 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3c8da-39a4-4804-a4e3-0f8b824ccf26 service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:55:59.644264 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 609/1214] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:55:59 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:56:05.881836 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2837134-f804-4d71-8487-68cd993ae633 None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:56:05.882404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2837134-f804-4d71-8487-68cd993ae633 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:56:05.882404 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2837134-f804-4d71-8487-68cd993ae633 None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:56:05.883726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 606/1215] 10.222.0.52 () {54 vars in 921 bytes} [Sat Sep 17 20:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:56:05.894165 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a1782-0bd7-4f32-be31-2eadd2772707 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:56:05.894699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a1782-0bd7-4f32-be31-2eadd2772707 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:56:05.894699 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a1782-0bd7-4f32-be31-2eadd2772707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:56:05.914684 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-e53a1782-0bd7-4f32-be31-2eadd2772707 None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:56:05.915879 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-e53a1782-0bd7-4f32-be31-2eadd2772707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:56:05.925187 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 610/1216] 10.222.0.52 () {58 vars in 1018 bytes} [Sat Sep 17 20:56:05 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:56:05.939237 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2837134-f804-4d71-8487-68cd993ae633 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:56:05.952844 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2837134-f804-4d71-8487-68cd993ae633 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:56:05.957893 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709f4f2-47d7-4b7b-830a-9ee2c49e838e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:56:05.958492 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f4f2-47d7-4b7b-830a-9ee2c49e838e service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:56:05.958774 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f4f2-47d7-4b7b-830a-9ee2c49e838e service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:56:05.959049 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f4f2-47d7-4b7b-830a-9ee2c49e838e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:56:05.968333 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f4f2-47d7-4b7b-830a-9ee2c49e838e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:56:05.969975 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f4f2-47d7-4b7b-830a-9ee2c49e838e service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:56:05.980245 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 607/1217] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:56:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:56:15.909701 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=12 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:15.975580 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=15 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:23.238728 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a1782-0bd7-4f32-be31-2eadd2772707 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:56:23.247932 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a1782-0bd7-4f32-be31-2eadd2772707 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:56:23.252098 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ddd73-8f3b-493e-85ea-937995b06b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:56:23.252692 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ddd73-8f3b-493e-85ea-937995b06b00 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:56:23.252970 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ddd73-8f3b-493e-85ea-937995b06b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:56:23.253264 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ddd73-8f3b-493e-85ea-937995b06b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:56:23.261968 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ddd73-8f3b-493e-85ea-937995b06b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:56:23.263394 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ddd73-8f3b-493e-85ea-937995b06b00 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:56:23.273532 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 611/1218] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:56:23 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:56:33.269239 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=6 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:24.290911 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb7701-83bd-4898-98ea-b6d86b71769d None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:57:24.291431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb7701-83bd-4898-98ea-b6d86b71769d None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:57:24.291431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb7701-83bd-4898-98ea-b6d86b71769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:57:24.311621 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-d6fb7701-83bd-4898-98ea-b6d86b71769d None None] MFA Rules not processed for user `56947fbba8cc440fbd8ecc3bd1c9f73f`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:57:24.313749 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-d6fb7701-83bd-4898-98ea-b6d86b71769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:57:24.323413 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 608/1219] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:57:24 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:57:34.305624 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:43.751311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8260b-ea5c-4950-af53-e8dd698ef3f3 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:57:43.751797 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8260b-ea5c-4950-af53-e8dd698ef3f3 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:57:43.751885 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8260b-ea5c-4950-af53-e8dd698ef3f3 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:57:43.753275 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 612/1220] 10.222.0.52 () {54 vars in 921 bytes} [Sat Sep 17 20:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 20:57:43.758346 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90ebc4-6f6e-42f8-bb31-47e15d3a82d1 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:57:43.758849 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90ebc4-6f6e-42f8-bb31-47e15d3a82d1 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:57:43.758951 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90ebc4-6f6e-42f8-bb31-47e15d3a82d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:57:43.816170 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-ae90ebc4-6f6e-42f8-bb31-47e15d3a82d1 None None] MFA Rules not processed for user `9674e78b7a6b41eb8a00aefff4cd22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:57:43.817559 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-ae90ebc4-6f6e-42f8-bb31-47e15d3a82d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:57:43.873389 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 609/1221] 10.222.0.52 () {58 vars in 1018 bytes} [Sat Sep 17 20:57:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:57:43.886644 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8260b-ea5c-4950-af53-e8dd698ef3f3 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:57:43.909192 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8260b-ea5c-4950-af53-e8dd698ef3f3 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:57:43.914248 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6f4e7-2647-4d29-897f-637053c841a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:57:43.915077 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6f4e7-2647-4d29-897f-637053c841a1 service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:57:43.915361 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6f4e7-2647-4d29-897f-637053c841a1 service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:57:43.915637 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6f4e7-2647-4d29-897f-637053c841a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:57:43.924693 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6f4e7-2647-4d29-897f-637053c841a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:57:43.926298 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6f4e7-2647-4d29-897f-637053c841a1 service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:57:43.936460 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 613/1222] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:57:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:57:53.871434 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=33 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:53.932394 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=6 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:58.901582 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933496-7dc8-4857-b4af-3699b6c65d37 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:57:58.902121 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933496-7dc8-4857-b4af-3699b6c65d37 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:57:58.902233 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933496-7dc8-4857-b4af-3699b6c65d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:57:58.927430 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-ce933496-7dc8-4857-b4af-3699b6c65d37 None None] MFA Rules not processed for user `56947fbba8cc440fbd8ecc3bd1c9f73f`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:57:58.928631 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-ce933496-7dc8-4857-b4af-3699b6c65d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:57:58.936405 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 610/1223] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:57:58 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:58:08.922438 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:16.399529 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f2c0-44b1-4be4-9ed0-e128d9a9a2ed None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:58:16.399989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f2c0-44b1-4be4-9ed0-e128d9a9a2ed None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:58:16.400086 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f2c0-44b1-4be4-9ed0-e128d9a9a2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:58:16.419054 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-3890f2c0-44b1-4be4-9ed0-e128d9a9a2ed None None] MFA Rules not processed for user `56947fbba8cc440fbd8ecc3bd1c9f73f`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:58:16.421209 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-3890f2c0-44b1-4be4-9ed0-e128d9a9a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:58:16.427965 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 614/1224] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:58:16 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:58:16.696061 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c577cfb-df76-491e-aa93-dbdbe54a00ae None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:58:16.696545 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c577cfb-df76-491e-aa93-dbdbe54a00ae None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:58:16.696650 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c577cfb-df76-491e-aa93-dbdbe54a00ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:58:16.733460 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-6c577cfb-df76-491e-aa93-dbdbe54a00ae None None] MFA Rules not processed for user `ca8186a27e64434f92b8bba23558cf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:58:16.734678 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-6c577cfb-df76-491e-aa93-dbdbe54a00ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:58:16.750607 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 611/1225] 10.222.0.52 () {58 vars in 1009 bytes} [Sat Sep 17 20:58:16 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:58:16.762071 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f2c0-44b1-4be4-9ed0-e128d9a9a2ed None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:58:16.771651 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f2c0-44b1-4be4-9ed0-e128d9a9a2ed None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:58:16.775168 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34759cd-0bd9-422b-b820-912bb1c2b04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:58:16.775751 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34759cd-0bd9-422b-b820-912bb1c2b04a service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:58:16.776024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34759cd-0bd9-422b-b820-912bb1c2b04a service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:58:16.776289 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34759cd-0bd9-422b-b820-912bb1c2b04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:58:16.785017 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34759cd-0bd9-422b-b820-912bb1c2b04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:58:16.785376 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34759cd-0bd9-422b-b820-912bb1c2b04a service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:58:16.793073 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 615/1226] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:58:16 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:58:26.747036 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=13 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:26.789602 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=9 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:41.783068 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c577cfb-df76-491e-aa93-dbdbe54a00ae None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:58:41.805727 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c577cfb-df76-491e-aa93-dbdbe54a00ae None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:58:41.810932 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdfec3-c086-4c90-808b-18da2eda65a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88caaed0c8c4438ea57d2f313fcf287a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:58:41.811591 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdfec3-c086-4c90-808b-18da2eda65a7 service placement] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:58:41.811941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdfec3-c086-4c90-808b-18da2eda65a7 service placement] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:58:41.812528 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdfec3-c086-4c90-808b-18da2eda65a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:58:41.822398 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdfec3-c086-4c90-808b-18da2eda65a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:58:41.824129 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdfec3-c086-4c90-808b-18da2eda65a7 service placement] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:58:41.834021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 612/1227] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:58:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:58:51.829884 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=10 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:34.711474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08bd2-a426-4feb-b73e-b5eb4dd0d3d0 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:59:34.711975 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08bd2-a426-4feb-b73e-b5eb4dd0d3d0 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:59:34.712071 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08bd2-a426-4feb-b73e-b5eb4dd0d3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:59:34.731384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-b6a08bd2-a426-4feb-b73e-b5eb4dd0d3d0 None None] MFA Rules not processed for user `56947fbba8cc440fbd8ecc3bd1c9f73f`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 20:59:34.732588 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-b6a08bd2-a426-4feb-b73e-b5eb4dd0d3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 20:59:34.740385 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 616/1228] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 20:59:34 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 20:59:44.726478 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:47.824081 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdfec3-c086-4c90-808b-18da2eda65a7 service placement] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 20:59:47.833761 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdfec3-c086-4c90-808b-18da2eda65a7 service placement] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 20:59:47.837355 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f25ec8-cf88-4fcc-a468-39780a3ec956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 20:59:47.837941 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f25ec8-cf88-4fcc-a468-39780a3ec956 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 20:59:47.838218 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f25ec8-cf88-4fcc-a468-39780a3ec956 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 20:59:47.838487 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f25ec8-cf88-4fcc-a468-39780a3ec956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 20:59:47.848187 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f25ec8-cf88-4fcc-a468-39780a3ec956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 20:59:47.849767 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f25ec8-cf88-4fcc-a468-39780a3ec956 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 20:59:47.859715 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 613/1229] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 20:59:47 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 20:59:57.855316 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=6 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:14.432481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09f6c0-22fc-4cb6-acb1-0ba8d97670f3 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:00:14.432964 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09f6c0-22fc-4cb6-acb1-0ba8d97670f3 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:00:14.432964 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09f6c0-22fc-4cb6-acb1-0ba8d97670f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:00:14.451604 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-6d09f6c0-22fc-4cb6-acb1-0ba8d97670f3 None None] MFA Rules not processed for user `940dd496b2b5409a9f80c97963060787`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 21:00:14.452792 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-6d09f6c0-22fc-4cb6-acb1-0ba8d97670f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:00:14.459646 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 617/1230] 10.222.0.52 () {58 vars in 958 bytes} [Sat Sep 17 21:00:14 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 21:00:24.446452 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:33.927535 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f25ec8-cf88-4fcc-a468-39780a3ec956 service neutron] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:00:33.948339 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f25ec8-cf88-4fcc-a468-39780a3ec956 service neutron] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:00:33.953366 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d8041-9240-4f1c-8b65-c62e51d97007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:00:33.953949 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d8041-9240-4f1c-8b65-c62e51d97007 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:00:33.954224 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d8041-9240-4f1c-8b65-c62e51d97007 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:00:33.954494 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d8041-9240-4f1c-8b65-c62e51d97007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:00:33.962702 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d8041-9240-4f1c-8b65-c62e51d97007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:00:33.964261 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d8041-9240-4f1c-8b65-c62e51d97007 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:00:33.972786 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 614/1231] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:00:33 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:00:43.968917 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=10 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:47.885389 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09f6c0-22fc-4cb6-acb1-0ba8d97670f3 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:00:47.894826 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09f6c0-22fc-4cb6-acb1-0ba8d97670f3 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:00:47.898600 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3baac-23e1-4157-8a99-831ce872a100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:00:47.899188 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3baac-23e1-4157-8a99-831ce872a100 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:00:47.899463 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3baac-23e1-4157-8a99-831ce872a100 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:00:47.899728 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3baac-23e1-4157-8a99-831ce872a100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:00:47.909293 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3baac-23e1-4157-8a99-831ce872a100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:00:47.910745 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3baac-23e1-4157-8a99-831ce872a100 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:00:47.920848 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 618/1232] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:00:47 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:00:57.916830 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=6 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:06.132600 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d8041-9240-4f1c-8b65-c62e51d97007 service nova] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:01:06.145414 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d8041-9240-4f1c-8b65-c62e51d97007 service nova] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:01:06.149045 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbd56e-6f5d-4ece-86d7-ecab06fd6d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:01:06.149726 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbd56e-6f5d-4ece-86d7-ecab06fd6d8f service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:01:06.153474 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbd56e-6f5d-4ece-86d7-ecab06fd6d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:01:06.153474 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbd56e-6f5d-4ece-86d7-ecab06fd6d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:01:06.158861 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbd56e-6f5d-4ece-86d7-ecab06fd6d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:01:06.160307 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbd56e-6f5d-4ece-86d7-ecab06fd6d8f service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:01:06.168719 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 615/1233] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:01:06 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:01:07.240116 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3baac-23e1-4157-8a99-831ce872a100 service neutron] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:01:07.248989 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3baac-23e1-4157-8a99-831ce872a100 service neutron] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:01:07.253143 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02e6b-7afd-4310-b1c7-ce56160a168e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:01:07.253788 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02e6b-7afd-4310-b1c7-ce56160a168e service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:01:07.254062 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02e6b-7afd-4310-b1c7-ce56160a168e service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:01:07.254329 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02e6b-7afd-4310-b1c7-ce56160a168e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:01:07.263789 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed02e6b-7afd-4310-b1c7-ce56160a168e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:01:07.266184 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed02e6b-7afd-4310-b1c7-ce56160a168e service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:01:07.276174 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 619/1234] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:01:07 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:01:16.164850 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=6 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:17.271919 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=6 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:51.530109 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbd56e-6f5d-4ece-86d7-ecab06fd6d8f service neutron] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:01:51.542644 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbd56e-6f5d-4ece-86d7-ecab06fd6d8f service neutron] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:01:51.550267 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f686-7b1e-44ec-9386-c51a703ae555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:01:51.552186 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f686-7b1e-44ec-9386-c51a703ae555 service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:01:51.552900 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f686-7b1e-44ec-9386-c51a703ae555 service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:01:51.553398 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f686-7b1e-44ec-9386-c51a703ae555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:01:51.563764 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f686-7b1e-44ec-9386-c51a703ae555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:01:51.565991 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f686-7b1e-44ec-9386-c51a703ae555 service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:01:51.577550 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 616/1235] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:01:51 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:02:01.572906 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=6 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:06.529966 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02e6b-7afd-4310-b1c7-ce56160a168e service neutron] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:02:06.538442 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02e6b-7afd-4310-b1c7-ce56160a168e service neutron] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:02:06.542551 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6ea2-1c41-41db-9de5-8ce86ec95d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:02:06.543130 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6ea2-1c41-41db-9de5-8ce86ec95d08 service neutron] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:06.543445 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6ea2-1c41-41db-9de5-8ce86ec95d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:06.543712 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6ea2-1c41-41db-9de5-8ce86ec95d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:06.614221 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6ea2-1c41-41db-9de5-8ce86ec95d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:02:06.615586 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6ea2-1c41-41db-9de5-8ce86ec95d08 service neutron] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:02:06.634474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 620/1236] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:02:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:02:10.666143 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aec03-dfb8-4679-85d7-3307f24d306b None None] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:10.666638 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aec03-dfb8-4679-85d7-3307f24d306b None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:10.666821 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aec03-dfb8-4679-85d7-3307f24d306b None None] PATH_INFO: `/` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:10.668087 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 617/1237] 10.222.0.52 () {54 vars in 921 bytes} [Sat Sep 17 21:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 21:02:10.696612 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6d08e-09a7-4a7b-a7e4-e556f951cd91 None None] REQUEST_METHOD: `POST` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:10.700054 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6d08e-09a7-4a7b-a7e4-e556f951cd91 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:10.700054 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6d08e-09a7-4a7b-a7e4-e556f951cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:10.739260 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.auth.core [None req-8cb6d08e-09a7-4a7b-a7e4-e556f951cd91 None None] MFA Rules not processed for user `88caaed0c8c4438ea57d2f313fcf287a`. Rule list: `[]` (Enabled: `True`). {{(pid=100114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 21:02:10.740513 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-8cb6d08e-09a7-4a7b-a7e4-e556f951cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:02:10.750485 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 621/1238] 10.222.0.52 () {58 vars in 1018 bytes} [Sat Sep 17 21:02:10 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 21:02:10.762143 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18aec03-dfb8-4679-85d7-3307f24d306b None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:02:10.776117 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18aec03-dfb8-4679-85d7-3307f24d306b None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:02:10.782497 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550a528-32b5-4261-a8ae-e0516fdef045 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88caaed0c8c4438ea57d2f313fcf287a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:02:10.782866 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a528-32b5-4261-a8ae-e0516fdef045 service placement] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:10.783155 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a528-32b5-4261-a8ae-e0516fdef045 service placement] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:10.783431 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a528-32b5-4261-a8ae-e0516fdef045 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:10.792580 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550a528-32b5-4261-a8ae-e0516fdef045 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:02:10.794225 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550a528-32b5-4261-a8ae-e0516fdef045 service placement] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:02:10.804401 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 618/1239] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:02:10 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:02:14.408560 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c5fc-b4f1-4298-9f29-c2e57d57e638 None None] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:14.409034 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c5fc-b4f1-4298-9f29-c2e57d57e638 None None] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:14.409143 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c5fc-b4f1-4298-9f29-c2e57d57e638 None None] PATH_INFO: `/` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:14.410469 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 622/1240] 10.222.0.52 () {54 vars in 921 bytes} [Sat Sep 17 21:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 21:02:14.429075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8477-bd03-4699-9730-5d17a3761a54 None None] REQUEST_METHOD: `POST` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:14.429075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8477-bd03-4699-9730-5d17a3761a54 None None] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:14.429075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8477-bd03-4699-9730-5d17a3761a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:14.446112 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.auth.core [None req-209b8477-bd03-4699-9730-5d17a3761a54 None None] MFA Rules not processed for user `88caaed0c8c4438ea57d2f313fcf287a`. Rule list: `[]` (Enabled: `True`). {{(pid=100115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 21:02:14.448080 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-209b8477-bd03-4699-9730-5d17a3761a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:02:14.456712 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 619/1241] 10.222.0.52 () {58 vars in 1018 bytes} [Sat Sep 17 21:02:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 21:02:14.469792 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c5fc-b4f1-4298-9f29-c2e57d57e638 None None] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:02:14.483585 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c5fc-b4f1-4298-9f29-c2e57d57e638 None None] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:02:14.488384 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9101f5-55fa-4ae2-9721-b8680f15686b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88caaed0c8c4438ea57d2f313fcf287a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:02:14.489018 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9101f5-55fa-4ae2-9721-b8680f15686b service placement] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:14.489326 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9101f5-55fa-4ae2-9721-b8680f15686b service placement] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:14.489597 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9101f5-55fa-4ae2-9721-b8680f15686b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:14.498427 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9101f5-55fa-4ae2-9721-b8680f15686b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:02:14.499960 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9101f5-55fa-4ae2-9721-b8680f15686b service placement] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:02:14.509364 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 623/1242] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:02:14 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:02:14.585943 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8477-bd03-4699-9730-5d17a3761a54 None None] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:02:14.596437 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8477-bd03-4699-9730-5d17a3761a54 None None] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:02:14.601787 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:02:14.602410 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:14.602685 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:14.602954 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] PATH_INFO: `/v3/users/940dd496b2b5409a9f80c97963060787` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:14.604073 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=940dd496b2b5409a9f80c97963060787)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:02:14.606027 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:02:14.840644 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940dd496b2b5409a9f80c97963060787'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:14.841338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940dd496b2b5409a9f80c97963060787'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:14.884174 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940dd496b2b5409a9f80c97963060787'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:14.891933 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940dd496b2b5409a9f80c97963060787'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:14.892567 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940dd496b2b5409a9f80c97963060787'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:14.910673 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 620/1243] 10.222.0.52 () {58 vars in 1224 bytes} [Sat Sep 17 21:02:14 2022] DELETE /identity/v3/users/940dd496b2b5409a9f80c97963060787 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 21:02:15.177558 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9101f5-55fa-4ae2-9721-b8680f15686b service placement] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:02:15.189453 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9101f5-55fa-4ae2-9721-b8680f15686b service placement] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:02:15.248671 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:02:15.249318 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:15.249596 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:15.249865 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] PATH_INFO: `/v3/projects/c75ebf2c145b463699596d41d903c29e` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:15.250973 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75ebf2c145b463699596d41d903c29e)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:02:15.252871 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:02:15.350570 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:15.353423 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75ebf2c145b463699596d41d903c29e', 'request_id': 'req-33638460-8bab-406f-b0a3-7f0c617f41f2'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.359019 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75ebf2c145b463699596d41d903c29e', 'request_id': 'req-33638460-8bab-406f-b0a3-7f0c617f41f2'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.433843 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75ebf2c145b463699596d41d903c29e', 'request_id': 'req-33638460-8bab-406f-b0a3-7f0c617f41f2'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.458183 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] The token cache is being invalidate because project c75ebf2c145b463699596d41d903c29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 21:02:15.458475 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.459112 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.460654 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 624/1244] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:15 2022] DELETE /identity/v3/projects/c75ebf2c145b463699596d41d903c29e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 21:02:15.465403 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:02:15.466981 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:02:15.479793 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8631a5-713c-40d3-a043-c5e1f7008832 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:02:15.537120 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:02:15.537773 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:15.538075 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:15.538341 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] PATH_INFO: `/v3/users/82b2d4945b684e25952440b903d2537a` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:15.539437 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b2d4945b684e25952440b903d2537a)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:02:15.541469 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:02:15.708331 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b2d4945b684e25952440b903d2537a'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.708910 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b2d4945b684e25952440b903d2537a'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.774264 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b2d4945b684e25952440b903d2537a'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.775690 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:15.783215 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b2d4945b684e25952440b903d2537a'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.783876 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b2d4945b684e25952440b903d2537a'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:15.800692 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 621/1245] 10.222.0.52 () {58 vars in 1224 bytes} [Sat Sep 17 21:02:15 2022] DELETE /identity/v3/users/82b2d4945b684e25952440b903d2537a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 21:02:16.076007 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:02:16.077569 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:02:16.090588 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638460-8bab-406f-b0a3-7f0c617f41f2 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:02:16.149798 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:02:16.150428 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:02:16.150705 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:02:16.150978 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] PATH_INFO: `/v3/projects/8cda79df9c344d24b7a8a14f506614cc` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:02:16.152119 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cda79df9c344d24b7a8a14f506614cc)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:02:16.154086 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:02:16.267765 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cda79df9c344d24b7a8a14f506614cc', 'request_id': 'req-22568bc2-ab59-45fc-aded-ed93dcdb0963'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:16.273445 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cda79df9c344d24b7a8a14f506614cc', 'request_id': 'req-22568bc2-ab59-45fc-aded-ed93dcdb0963'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:16.351056 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cda79df9c344d24b7a8a14f506614cc', 'request_id': 'req-22568bc2-ab59-45fc-aded-ed93dcdb0963'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:16.362967 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] The token cache is being invalidate because project 8cda79df9c344d24b7a8a14f506614cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 21:02:16.363253 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:16.363881 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:02:16.365369 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 625/1246] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:16 2022] DELETE /identity/v3/projects/8cda79df9c344d24b7a8a14f506614cc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 21:02:25.918664 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:26.359951 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:DELETE=11,keystone:SELECT=63,keystone:INSERT=2 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:10.919762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:03:10.921338 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:11.002411 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43889d-bd7b-4f7f-9ae4-7fbca0933349 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:03:11.060881 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:03:11.061574 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:03:11.061799 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:03:11.062071 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:03:11.063894 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:11.122288 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:03:11.123883 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:03:11.133026 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 622/1247] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:03:10 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:03:14.719632 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:03:14.721090 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:14.735425 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22568bc2-ab59-45fc-aded-ed93dcdb0963 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:03:14.740355 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9674e78b7a6b41eb8a00aefff4cd22c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:03:14.740938 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:03:14.741740 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:03:14.741998 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:03:14.743669 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:14.754491 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:03:14.756069 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:03:14.766084 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 626/1248] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:03:14 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:03:21.128631 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=85 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:23.942375 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:03:23.945947 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:24.012694 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e72d94-8ab7-404e-9f72-a0f9aba3347c service nova] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:03:24.016399 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3beee-32fc-4958-85db-fcbf0a05d5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca8186a27e64434f92b8bba23558cf8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:03:24.017000 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3beee-32fc-4958-85db-fcbf0a05d5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:03:24.017306 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3beee-32fc-4958-85db-fcbf0a05d5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:03:24.017592 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3beee-32fc-4958-85db-fcbf0a05d5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:03:24.019252 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-f6c3beee-32fc-4958-85db-fcbf0a05d5c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:24.081981 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3beee-32fc-4958-85db-fcbf0a05d5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:03:24.084187 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3beee-32fc-4958-85db-fcbf0a05d5c8 service neutron] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:03:24.093877 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 623/1249] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:03:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 21:03:24.762218 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=6 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:31.535294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:03:31.535294 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:31.549950 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776413fd-794c-424c-9954-e7bca7f71e3f service nova] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:03:31.554827 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:03:31.555446 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:03:31.555727 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:03:31.556003 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] PATH_INFO: `/v3/users/56947fbba8cc440fbd8ecc3bd1c9f73f` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:03:31.557123 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56947fbba8cc440fbd8ecc3bd1c9f73f)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:03:31.558189 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: WARNING py.warnings [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 21:03:31.558189 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: warnings.warn(msg) Sep 17 21:03:31.558189 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: Sep 17 21:03:31.559388 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:03:31.732082 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56947fbba8cc440fbd8ecc3bd1c9f73f'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:31.732742 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56947fbba8cc440fbd8ecc3bd1c9f73f'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:31.789263 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56947fbba8cc440fbd8ecc3bd1c9f73f'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:31.789864 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56947fbba8cc440fbd8ecc3bd1c9f73f'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:31.800998 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56947fbba8cc440fbd8ecc3bd1c9f73f'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:31.830526 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 627/1250] 10.222.0.52 () {58 vars in 1224 bytes} [Sat Sep 17 21:03:31 2022] DELETE /identity/v3/users/56947fbba8cc440fbd8ecc3bd1c9f73f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 21:03:32.055154 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3beee-32fc-4958-85db-fcbf0a05d5c8 service neutron] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:03:32.066045 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3beee-32fc-4958-85db-fcbf0a05d5c8 service neutron] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:03:32.122139 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:03:32.122746 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:03:32.123021 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:03:32.123289 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] PATH_INFO: `/v3/projects/0fa97092b299480c8e707503ffaf79e1` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:03:32.124381 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa97092b299480c8e707503ffaf79e1)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:03:32.125427 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: WARNING py.warnings [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 21:03:32.125427 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: warnings.warn(msg) Sep 17 21:03:32.125427 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: Sep 17 21:03:32.126677 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:03:32.216033 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:32.225762 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa97092b299480c8e707503ffaf79e1', 'request_id': 'req-f8036e85-3409-4179-be15-0401ad0e5c74'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.280422 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa97092b299480c8e707503ffaf79e1', 'request_id': 'req-f8036e85-3409-4179-be15-0401ad0e5c74'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.287430 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa97092b299480c8e707503ffaf79e1', 'request_id': 'req-f8036e85-3409-4179-be15-0401ad0e5c74'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.306858 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] The token cache is being invalidate because project 0fa97092b299480c8e707503ffaf79e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 21:03:32.307088 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.307753 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.309283 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 624/1251] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 17 21:03:32 2022] DELETE /identity/v3/projects/0fa97092b299480c8e707503ffaf79e1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 21:03:32.313281 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:03:32.319213 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:32.328825 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e2e0c-f8fd-4d30-bfc6-7f69bfbfb608 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:03:32.385940 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:03:32.386567 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:03:32.386999 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:03:32.387281 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] PATH_INFO: `/v3/users/284fc44c0bfc4134bf2d894cc779a745` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:03:32.388404 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=284fc44c0bfc4134bf2d894cc779a745)` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:03:32.390383 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:03:32.626079 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284fc44c0bfc4134bf2d894cc779a745'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.627814 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284fc44c0bfc4134bf2d894cc779a745'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.697474 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284fc44c0bfc4134bf2d894cc779a745'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.698153 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284fc44c0bfc4134bf2d894cc779a745'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.706024 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.notifications [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284fc44c0bfc4134bf2d894cc779a745'} {{(pid=100114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:32.713983 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:32.723438 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 628/1252] 10.222.0.52 () {58 vars in 1224 bytes} [Sat Sep 17 21:03:32 2022] DELETE /identity/v3/users/284fc44c0bfc4134bf2d894cc779a745 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 21:03:32.990695 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] Authenticating user token {{(pid=100115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:03:32.992264 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.fernet_utils [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:33.015960 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8036e85-3409-4179-be15-0401ad0e5c74 admin admin] Validating token access rules against request {{(pid=100115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:03:33.076645 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b97854cfd447a990a1e65cc1830977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1449954a4a84885b4be97fe68c1c864', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:03:33.077313 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:03:33.077587 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:03:33.077856 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] PATH_INFO: `/v3/projects/32b8bdc6df7647709a77962d2118fb8f` {{(pid=100115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:03:33.078987 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b8bdc6df7647709a77962d2118fb8f)` {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:03:33.081227 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] RBAC: Authorization granted {{(pid=100115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:03:33.161340 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b8bdc6df7647709a77962d2118fb8f', 'request_id': 'req-bf2f6b94-f874-479a-8f32-0bc330009c01'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:33.206223 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b8bdc6df7647709a77962d2118fb8f', 'request_id': 'req-bf2f6b94-f874-479a-8f32-0bc330009c01'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:33.211716 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b8bdc6df7647709a77962d2118fb8f', 'request_id': 'req-bf2f6b94-f874-479a-8f32-0bc330009c01'} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:33.223532 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] The token cache is being invalidate because project 32b8bdc6df7647709a77962d2118fb8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 21:03:33.223818 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:33.224455 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG keystone.notifications [None req-bf2f6b94-f874-479a-8f32-0bc330009c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 21:03:33.225959 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: [pid: 100115|app: 0|req: 625/1253] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 17 21:03:32 2022] DELETE /identity/v3/projects/32b8bdc6df7647709a77962d2118fb8f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 21:03:42.863636 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:43.219654 dv-osbrick-master-4-ceph devstack@keystone.service[100115]: DEBUG dbcounter [-] [100115] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=100115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:48.763442 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] Authenticating user token {{(pid=100114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 21:03:48.764855 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:48.847323 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fb9e6-c7cd-417b-b7d7-bd3d30aca221 admin admin] Validating token access rules against request {{(pid=100114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 21:03:48.910311 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6461014-d4a0-49b5-b0fa-fc4a2ea288a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88caaed0c8c4438ea57d2f313fcf287a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8626e1dba10a49f2a16ae81553658423', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 21:03:48.910926 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6461014-d4a0-49b5-b0fa-fc4a2ea288a0 service placement] REQUEST_METHOD: `GET` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 21:03:48.911205 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6461014-d4a0-49b5-b0fa-fc4a2ea288a0 service placement] SCRIPT_NAME: `/identity` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 21:03:48.911481 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6461014-d4a0-49b5-b0fa-fc4a2ea288a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 21:03:48.913255 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.fernet_utils [None req-c6461014-d4a0-49b5-b0fa-fc4a2ea288a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 21:03:48.924284 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6461014-d4a0-49b5-b0fa-fc4a2ea288a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 21:03:48.925911 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6461014-d4a0-49b5-b0fa-fc4a2ea288a0 service placement] RBAC: Authorization granted {{(pid=100114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 21:03:48.935732 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: [pid: 100114|app: 0|req: 629/1254] 10.222.0.52 () {60 vars in 1365 bytes} [Sat Sep 17 21:03:48 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 21:03:58.931504 dv-osbrick-master-4-ceph devstack@keystone.service[100114]: DEBUG dbcounter [-] [100114] Writing DB stats keystone:SELECT=63 {{(pid=100114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}